-- Logs begin at Wed 2022-08-31 04:38:57 UTC, end at Wed 2022-08-31 05:34:35 UTC. -- Aug 31 05:04:43.868215 dv-cinder-852208-14-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 05:04:43.875715 dv-cinder-852208-14-smb devstack@keystone.service[81560]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 05:04:43 2022] *** Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: nodename: dv-cinder-852208-14-smb Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: machine: x86_64 Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: clock source: unix Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: pcre jit disabled Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: detected number of CPU cores: 4 Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: current working directory: / Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: detected binary path: /usr/bin/uwsgi-core Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: your processes number limit is 47680 Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: your memory page size is 4096 bytes Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: detected max file descriptor number: 2048 Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: lock engine: pthread robust mutexes Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: thunder lock: enabled Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 05:04:43.880705 dv-cinder-852208-14-smb devstack@keystone.service[81560]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 05:04:43.917892 dv-cinder-852208-14-smb devstack@keystone.service[81560]: Python main interpreter initialized at 0x562dbfe989c0 Aug 31 05:04:43.917892 dv-cinder-852208-14-smb devstack@keystone.service[81560]: python threads support enabled Aug 31 05:04:43.917892 dv-cinder-852208-14-smb devstack@keystone.service[81560]: your server socket listen backlog is limited to 100 connections Aug 31 05:04:43.917892 dv-cinder-852208-14-smb devstack@keystone.service[81560]: your mercy for graceful operations on workers is 90 seconds Aug 31 05:04:43.918287 dv-cinder-852208-14-smb devstack@keystone.service[81560]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 05:04:43.918287 dv-cinder-852208-14-smb devstack@keystone.service[81560]: *** Operational MODE: preforking *** Aug 31 05:04:43.918591 dv-cinder-852208-14-smb devstack@keystone.service[81560]: *** uWSGI is running in multiple interpreter mode *** Aug 31 05:04:43.918591 dv-cinder-852208-14-smb devstack@keystone.service[81560]: spawned uWSGI master process (pid: 81560) Aug 31 05:04:43.918812 dv-cinder-852208-14-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 05:04:43.919669 dv-cinder-852208-14-smb devstack@keystone.service[81560]: spawned uWSGI worker 1 (pid: 81573, cores: 1) Aug 31 05:04:43.919926 dv-cinder-852208-14-smb devstack@keystone.service[81560]: spawned uWSGI worker 2 (pid: 81574, cores: 1) Aug 31 05:04:43.920748 dv-cinder-852208-14-smb devstack@keystone.service[81560]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 05:04:48.149754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:04:48.149754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: from cryptography.utils import int_from_bytes Aug 31 05:04:48.150570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:04:48.150570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: from cryptography.utils import int_from_bytes Aug 31 05:04:48.151117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:04:48.151117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: from cryptography.utils import int_from_bytes Aug 31 05:04:48.151635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 05:04:48.151635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: from cryptography.utils import int_from_bytes Aug 31 05:04:48.198919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 05:04:48.199128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 05:04:48.199282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] command line args: [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 05:04:48.199569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 05:04:48.199808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ================================================================================ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 05:04:48.200102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] admin_token = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.200346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_dir = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.200510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.200719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_source = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.200854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] debug = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.200932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 05:04:48.201148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.201428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 05:04:48.201428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] command line args: [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 05:04:48.201560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.201626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 05:04:48.201699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.201761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ================================================================================ {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 05:04:48.201827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] admin_token = **** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] config_dir = [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_config_append = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202586 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] config_source = [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] debug = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_dir = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.202964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203362 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.203986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] list_limit = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] log_config_append = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] log_dir = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] log_file = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.204910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.205983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.206079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.206232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.206322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.206492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.206728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.206812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.206886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] publish_errors = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.206969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.207114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.207204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.207341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.207448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.207572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.207658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.207780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.207935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.208019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.208195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] standard_threads = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.208285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.208420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.208638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.208755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.208889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.208970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] publish_errors = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_journal = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_json = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_stderr = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209424 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_syslog = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.209952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.210029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.210157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.210264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] standard_threads = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.210412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.210497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.210646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.210741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.210891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.210968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.211070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] use_journal = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.211155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.211236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] use_json = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.211355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.211484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] use_stderr = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.211561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] use_syslog = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.211638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.211793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 05:04:48.211884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.212982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.213066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.213250 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.213340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.213494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.213581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.213724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.213804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.213973 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.214063 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.214221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.214306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.214458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.214544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.214689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.214777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.214938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.215968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.216109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.216188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.216335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.216414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.216564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.216649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.216809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.216889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.217052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.217157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.217300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.217380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.217526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.217606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.217769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.217855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218092 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.218952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.219937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.220085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.220163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.220316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.220396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.220559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.220638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.220785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.220864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.221952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222253 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.222951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.223174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.223270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.223469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.223555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.223693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.223827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.223939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.224071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.224182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.224317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.224423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.224529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.224625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.224769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.224884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.225974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.226060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.226228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.226319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.226465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.226543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.226702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.226780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.226936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.227957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.228103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.228225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.228339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.228426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.228570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.228683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.228799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.228876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.229986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.230067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.230241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.230319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.230473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.230552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.230715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.230794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.230950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.231962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.232112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.232191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.232337 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.232417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.232565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.232641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.232777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.232856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233483 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.233956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.234994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.235136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.235223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.external = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.235361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.235447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.235590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.235669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.235833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.235916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.236071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.236185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.password = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.236296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.token = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.236385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.236532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.236615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.236763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.236843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] auth.external = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.237966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.238046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.238196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.238277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.238438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.238526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] auth.password = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.238739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] auth.token = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.238827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.238985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.239066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.239223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.239313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.239474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.239554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.239708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.239790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.239957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.240046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.240208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.240288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.240442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.240522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.240679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] credential.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.240768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.240930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.241012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.241205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.241297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.241459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.241548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.241707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.241821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.241949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.242987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.243121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.243209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.243363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.243446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.243594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.243686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.243845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.243928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.244076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.244158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.244328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.244411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.244562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.244642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] federation.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.244808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.244889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.245037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.245150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.245308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.245389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.245552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.245631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.245780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.245862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.246947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.247957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.248113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.248194 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.248354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.248434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.248595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.248676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.248828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.248914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.249069 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.249170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.249358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.249454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.249593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.249701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.249827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.249939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.250998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.251161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.251251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.251421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.251521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.251649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.251779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.251893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.251975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.252136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.252228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.252367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.252546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.252622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.252695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.252827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.252918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.253058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.253191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.253317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.253399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.253542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.253629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.253776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.253859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.254006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.254086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.254268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.254398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.254549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.254663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.254795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.254876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.255031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.255113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.255280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.255360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.255529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.255609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.255761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.255843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.256930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.257989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.258150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.258231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.258393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.258474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.258635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.258717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.258856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.258935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.259994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.260074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.260240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.260320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.260481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.260561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.260723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.260803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.260964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.261045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.261235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.261315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.261462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.261542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.261693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.261773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.261926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.262941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.263429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.263514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.263659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.263738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.263911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.263992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.264137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.264272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.264376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.264455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.264606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.264686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.264838 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.264919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.265069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.265199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.265330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.265437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.265567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.265683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.265817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.265898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.266068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.266150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.266308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.266389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.266567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.266647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.266798 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.266880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267281 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.267994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.268074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.268228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.268310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.268460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.268539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.268690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.268768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.268930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] resource.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.269010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.269189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.269269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.269435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.269596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.269674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.269746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.269965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.270045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.270216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.270303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.270452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.270530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.270691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.270770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.270928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] role.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] role.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.271948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.272111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.272191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.272353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.272442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.272603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.272753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.272857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.272991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.273125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.273264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.273362 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.273512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.273613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.273757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.273865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274085 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.274960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.275089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.275190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.275417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.275534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.275644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.275725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.275891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.275971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.276146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.276227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.276390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.276471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.276622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.276701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.276852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.276933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.277078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.277175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.277330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.277411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.277564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.277646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.277808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.277888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.278990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.279072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.279225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.279306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.279462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.279541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.279690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.279770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.279925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] token.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.280970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.281140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.281237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.281390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.281469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.281638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.281719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.281874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.282894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283048 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.283976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.284057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.284213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.284302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.connection = **** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.284442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.284523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.284683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.284764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.284915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.285004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.285184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.285267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.285413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.285494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.285694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.285786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.285941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.286022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.286158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 05:04:48.286293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.286418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.286635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.286886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.287122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.287371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.287610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.287855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.288088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.288328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.288565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 05:04:48.288736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 05:04:48.315087 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.315353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.315566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.317222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.317456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.317682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.323923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.326032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.351690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.351918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.353713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.353949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.404284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.405232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.452891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.453070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.453483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.453718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.608920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.609261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.609354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.609598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.609793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.609889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.610024 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.610168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.610300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.610449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.610683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.610865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.632824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.633140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.633236 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.633477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.633614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.633707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.633787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.633853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.633927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.634067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.634192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.634316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.634561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.634769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.645617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.646090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.658205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.658408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.658521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.658744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.658869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.658957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.659147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.659276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.659347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.659426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.659592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.659804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.660028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.660217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81574) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 05:04:48.676584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.676845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 05:04:48.677165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.677299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.677383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 05:04:48.677466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 05:04:48.677609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.677740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.677869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.677966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 05:04:48.678157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.678283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.678392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.678498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.678948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.679232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.687907 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.688180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.688456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.688606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.688692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.688851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.689133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.689455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.695831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.696460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.698715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.698998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.699276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.699474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.699570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.699700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.699826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.699951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.700075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.700209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.700343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.700518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.700642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.700771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.700908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.701038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.701189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.701320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.701448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.701589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.701900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.702171 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.723953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.725078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.725426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.725702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.726573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.726856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.731091 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.731376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.731508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.731707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.731805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.732072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.738083 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.738366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.738491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.738850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.742333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.742621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.742743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.742957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.743050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.743187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.743343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.743436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.743606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.743916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.744205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.744479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.744752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.745486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.745769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.746049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.761744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.761894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.762109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.762220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.766136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.766332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.769197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.769499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.769650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.770075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.773780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.774387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.776830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.777559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.779924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.780218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.780506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.780753 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.780900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.781131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.781262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.781409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.781536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.781678 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.781941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.782223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.796940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.797254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.797536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.797809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.798025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.798317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.798594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.798876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.804532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.806100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.806246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.807639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.807768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.807941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.809193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.809499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.810605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.810886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.811175 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.811457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.811749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.812145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.812443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.812857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.813157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.813457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.823078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.823364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.823637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.823926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.824208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.824481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.824799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.825320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.825609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.825983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.826273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.826562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.826857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.827162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.840312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.843034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.843360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.846329 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.846591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.848058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.849494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.849626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.849875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.850162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.850946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.852559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.852868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.853177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.856583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.858082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.860779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.860906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.861229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.861514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.861794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.862297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.865376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.865674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.865963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.866243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.869860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.870150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.870432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.874041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.874349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.874640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.877259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.877542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.877825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.878098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.878371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.878649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.878923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.879199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.879552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.879865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.880135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.880394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.880659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.880938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.881644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81574) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 05:04:48.881934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.882223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.882488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.882762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.883037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.883321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.883601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.883881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.884161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.884436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.884701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.884967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.885278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81574) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 05:04:48.914890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562dbfe989c0 pid: 81573 (default app) Aug 31 05:04:48.918308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d932b7-5593-42de-9162-62edddb3809e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:48.918591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d932b7-5593-42de-9162-62edddb3809e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:48.918858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d932b7-5593-42de-9162-62edddb3809e None None] PATH_INFO: `/v3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:48.919566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562dbfe989c0 pid: 81574 (default app) Aug 31 05:04:48.923065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Aug 31 05:04:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:04:55.502986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca627ce7-1731-44ca-b1f8-b7e6f6dc9cc9 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:55.503514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca627ce7-1731-44ca-b1f8-b7e6f6dc9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:55.503624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca627ce7-1731-44ca-b1f8-b7e6f6dc9cc9 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:55.508325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:04:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:04:55.515125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:55.515657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:55.515812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:55.592627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: INFO dbcounter [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] Registered counter for database keystone Aug 31 05:04:55.613674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG oslo_db.sqlalchemy.engines [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:04:55.622860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writer thread running {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:04:55.822147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG passlib.handlers.bcrypt [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81573) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 05:04:55.822537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG passlib.handlers.bcrypt [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81573) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 05:04:55.881357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:04:55.882945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:04:56.014671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:04:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 05:04:56.311308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca627ce7-1731-44ca-b1f8-b7e6f6dc9cc9 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:04:56.382216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: INFO dbcounter [None req-ca627ce7-1731-44ca-b1f8-b7e6f6dc9cc9 None None] Registered counter for database keystone Aug 31 05:04:56.408464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG oslo_db.sqlalchemy.engines [None req-ca627ce7-1731-44ca-b1f8-b7e6f6dc9cc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 05:04:56.416718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writer thread running {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 05:04:56.537529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca627ce7-1731-44ca-b1f8-b7e6f6dc9cc9 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:04:56.546673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab7b1f-3d00-4e7b-a583-fcd5b726db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:04:56.547692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7b1f-3d00-4e7b-a583-fcd5b726db0f admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:56.548162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7b1f-3d00-4e7b-a583-fcd5b726db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:56.548603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab7b1f-3d00-4e7b-a583-fcd5b726db0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:56.559095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab7b1f-3d00-4e7b-a583-fcd5b726db0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:04:56.609755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING keystone.common.rbac_enforcer.enforcer [None req-80ab7b1f-3d00-4e7b-a583-fcd5b726db0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 05:04:56.610092 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab7b1f-3d00-4e7b-a583-fcd5b726db0f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:04:56.621836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Aug 31 05:04:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:04:56.630456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:04:56.651597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f20f-9425-4a6a-8d02-0c945949efaf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:04:56.658152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593625f4-c4f7-456c-ad4e-0a96709df3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:04:56.659279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593625f4-c4f7-456c-ad4e-0a96709df3af admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:56.659561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593625f4-c4f7-456c-ad4e-0a96709df3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:56.659836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593625f4-c4f7-456c-ad4e-0a96709df3af admin admin] PATH_INFO: `/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:56.661921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593625f4-c4f7-456c-ad4e-0a96709df3af admin admin] RBAC: Authorizing `identity:get_project(project_id=2e8c567a5ea14fdea15f5fb60bb768ec)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:04:56.713638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING keystone.common.rbac_enforcer.enforcer [None req-593625f4-c4f7-456c-ad4e-0a96709df3af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 05:04:56.713980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593625f4-c4f7-456c-ad4e-0a96709df3af admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:04:56.718646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Aug 31 05:04:56 2022] GET /identity/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:04:58.599257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc407baf-1c51-43bd-b18b-624539729e38 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:58.600200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc407baf-1c51-43bd-b18b-624539729e38 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:58.600200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc407baf-1c51-43bd-b18b-624539729e38 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:58.607043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:04:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:04:58.612665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954c78-0003-4dd2-9bc9-a3d6b6e0259c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:58.613132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954c78-0003-4dd2-9bc9-a3d6b6e0259c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:58.613232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954c78-0003-4dd2-9bc9-a3d6b6e0259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:58.635447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9f954c78-0003-4dd2-9bc9-a3d6b6e0259c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:04:58.636984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9f954c78-0003-4dd2-9bc9-a3d6b6e0259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:04:58.646297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:04:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 05:04:58.909838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc407baf-1c51-43bd-b18b-624539729e38 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:04:58.929570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc407baf-1c51-43bd-b18b-624539729e38 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:04:58.934529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5949cf6-2965-4483-b903-21a31d8521a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:04:58.935135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949cf6-2965-4483-b903-21a31d8521a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:58.935412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949cf6-2965-4483-b903-21a31d8521a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:58.935680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949cf6-2965-4483-b903-21a31d8521a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:58.944223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5949cf6-2965-4483-b903-21a31d8521a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:04:58.946042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5949cf6-2965-4483-b903-21a31d8521a0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:04:58.955254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Aug 31 05:04:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:04:58.961725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f954c78-0003-4dd2-9bc9-a3d6b6e0259c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:04:58.976926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f954c78-0003-4dd2-9bc9-a3d6b6e0259c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:04:58.985882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198bdc8-0311-4066-9f54-6c084e6fbbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:04:58.986822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198bdc8-0311-4066-9f54-6c084e6fbbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:04:58.987195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198bdc8-0311-4066-9f54-6c084e6fbbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:04:58.987554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198bdc8-0311-4066-9f54-6c084e6fbbdc admin admin] PATH_INFO: `/v3/users/08b48eac02ed4bf2b170e97ff2aa351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:04:58.989655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198bdc8-0311-4066-9f54-6c084e6fbbdc admin admin] RBAC: Authorizing `identity:get_user(user_id=08b48eac02ed4bf2b170e97ff2aa351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:04:58.991514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198bdc8-0311-4066-9f54-6c084e6fbbdc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:04:58.993079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Aug 31 05:04:58 2022] GET /identity/v3/users/08b48eac02ed4bf2b170e97ff2aa351b => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:00.960160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7d79-2543-41b3-a4a4-bd463617dcef None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:00.960673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7d79-2543-41b3-a4a4-bd463617dcef None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:00.960673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7d79-2543-41b3-a4a4-bd463617dcef None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:00.962077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:00.967297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482239-42a1-4aca-bc8c-8a13f4a57520 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:00.967691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482239-42a1-4aca-bc8c-8a13f4a57520 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:00.967853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86482239-42a1-4aca-bc8c-8a13f4a57520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:00.986858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-86482239-42a1-4aca-bc8c-8a13f4a57520 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:00.988057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-86482239-42a1-4aca-bc8c-8a13f4a57520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:01.008629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036133b-f626-4804-942e-356e93b23685 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:01.008906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036133b-f626-4804-942e-356e93b23685 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:01.009216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036133b-f626-4804-942e-356e93b23685 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:01.010501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:01.015775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:01.016057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:01.016327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:01.059042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG passlib.handlers.bcrypt [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81574) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 05:05:01.059433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG passlib.handlers.bcrypt [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81574) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 05:05:01.074262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:01.108168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:01.109833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:01.216114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:01.336058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86482239-42a1-4aca-bc8c-8a13f4a57520 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:01.360540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:01.446092 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86482239-42a1-4aca-bc8c-8a13f4a57520 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:01.476902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:01.480513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00645572-e9e8-4912-b6d1-3faadfc7fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:01.481227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00645572-e9e8-4912-b6d1-3faadfc7fd0c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:01.481504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00645572-e9e8-4912-b6d1-3faadfc7fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:01.481774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00645572-e9e8-4912-b6d1-3faadfc7fd0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:01.493638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00645572-e9e8-4912-b6d1-3faadfc7fd0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-00645572-e9e8-4912-b6d1-3faadfc7fd0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:01.502454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:01.503607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:01.504821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:01.509640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00645572-e9e8-4912-b6d1-3faadfc7fd0c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:01.577604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c1e9d-32e1-4847-8de4-a6f6f4aa7430 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:01.579823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:01.592165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:01.610561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00645572-e9e8-4912-b6d1-3faadfc7fd0c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:01.614053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8c6d8-b046-4be8-b7fa-dafe908ebcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:01.614932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8c6d8-b046-4be8-b7fa-dafe908ebcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:01.615213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8c6d8-b046-4be8-b7fa-dafe908ebcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:01.615482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8c6d8-b046-4be8-b7fa-dafe908ebcc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:01.648892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:01.649581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:01.649868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:01.650135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:01.650827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:01.651120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:01.652542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:01.664725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:01.670632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:01.683230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8c6d8-b046-4be8-b7fa-dafe908ebcc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:01.684745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8c6d8-b046-4be8-b7fa-dafe908ebcc8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:01.772788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc06c-1dc6-4273-a971-eed66a7f7707 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:01.780376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:01.786154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8c6d8-b046-4be8-b7fa-dafe908ebcc8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:01.788914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:01.807299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a4f36-76e2-47a7-8fb9-e29745fbec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:01.807941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a4f36-76e2-47a7-8fb9-e29745fbec28 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:01.808222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a4f36-76e2-47a7-8fb9-e29745fbec28 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:01.808494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a4f36-76e2-47a7-8fb9-e29745fbec28 None admin] PATH_INFO: `/v3/users/08b48eac02ed4bf2b170e97ff2aa351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:01.809690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a4f36-76e2-47a7-8fb9-e29745fbec28 None admin] RBAC: Authorizing `identity:get_user(user_id=08b48eac02ed4bf2b170e97ff2aa351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:01.811156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a4f36-76e2-47a7-8fb9-e29745fbec28 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:01.812733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:01 2022] GET /identity/v3/users/08b48eac02ed4bf2b170e97ff2aa351b => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:01.818425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a4f36-76e2-47a7-8fb9-e29745fbec28 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:01.832746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:01.889440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8c6d8-b046-4be8-b7fa-dafe908ebcc8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:01.920559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a4f36-76e2-47a7-8fb9-e29745fbec28 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:01.922830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:01.923701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:01.923983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:01.924253 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:01.942757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:01.944242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:01.955384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34697-91a7-4a92-839b-bab59d430563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:01.956021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34697-91a7-4a92-839b-bab59d430563 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:01.956294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34697-91a7-4a92-839b-bab59d430563 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:01.956564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d34697-91a7-4a92-839b-bab59d430563 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:01.957758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34697-91a7-4a92-839b-bab59d430563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:01.959170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d34697-91a7-4a92-839b-bab59d430563 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:01.960714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:05:01.962681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:01.963988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:05:01.964813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:05:01.964813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:05:01.964813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:01.964813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:01.966688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34697-91a7-4a92-839b-bab59d430563 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:01.969610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:02.026242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:02.046355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:02.065635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d34697-91a7-4a92-839b-bab59d430563 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:02.073060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029e822-60c5-4c08-a909-6c127e218a85 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:02.099626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5801d-2d1d-4d0e-b32a-42ca221d6412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:02.100222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5801d-2d1d-4d0e-b32a-42ca221d6412 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:02.100540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5801d-2d1d-4d0e-b32a-42ca221d6412 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:02.100810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5801d-2d1d-4d0e-b32a-42ca221d6412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:02.101563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5801d-2d1d-4d0e-b32a-42ca221d6412 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.domain.id=default, user.id=08b48eac02ed4bf2b170e97ff2aa351b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:02.101868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5801d-2d1d-4d0e-b32a-42ca221d6412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:02.103290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5801d-2d1d-4d0e-b32a-42ca221d6412 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:02.105858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88103f2-8fe0-43fe-948f-5e93c23b3c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:02.106468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88103f2-8fe0-43fe-948f-5e93c23b3c42 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:02.106750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88103f2-8fe0-43fe-948f-5e93c23b3c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:02.107025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88103f2-8fe0-43fe-948f-5e93c23b3c42 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:02.107669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88103f2-8fe0-43fe-948f-5e93c23b3c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:02.107972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88103f2-8fe0-43fe-948f-5e93c23b3c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:02.109367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88103f2-8fe0-43fe-948f-5e93c23b3c42 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:02.109937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Aug 31 05:05:01 2022] GET /identity/v3/role_assignments?user.id=08b48eac02ed4bf2b170e97ff2aa351b&scope.domain.id=default&role.id=6da07502c09e4fc8afb31b58e434479b => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:02.128775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:04.116924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793975-9e16-4ba4-9bb8-42911acfe70e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:04.118043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793975-9e16-4ba4-9bb8-42911acfe70e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:04.118523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41793975-9e16-4ba4-9bb8-42911acfe70e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:04.120072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:04.125637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b727399-f82d-4e30-bc75-23ba7fa86ade None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:04.126446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b727399-f82d-4e30-bc75-23ba7fa86ade None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:04.126921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b727399-f82d-4e30-bc75-23ba7fa86ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:04.146719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-3b727399-f82d-4e30-bc75-23ba7fa86ade None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:04.148240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3b727399-f82d-4e30-bc75-23ba7fa86ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:04.240724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:04.558936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150f6d-2a74-456a-a0d8-57eb3be7abfd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:04.559645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150f6d-2a74-456a-a0d8-57eb3be7abfd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:04.560115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0150f6d-2a74-456a-a0d8-57eb3be7abfd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:04.561678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:04.567521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052727d3-0fed-4195-82ea-f902270cd4dc None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:04.568052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052727d3-0fed-4195-82ea-f902270cd4dc None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:04.568535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052727d3-0fed-4195-82ea-f902270cd4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:04.605251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-052727d3-0fed-4195-82ea-f902270cd4dc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:04.606786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-052727d3-0fed-4195-82ea-f902270cd4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:04.673501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:04.706467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 12/25] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:04.753900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932fa2-afc4-44e5-8b41-ce20a598975d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:04.754543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932fa2-afc4-44e5-8b41-ce20a598975d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:04.755022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb932fa2-afc4-44e5-8b41-ce20a598975d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:04.756803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 14/26] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:04.762636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca737-09f1-445f-bba7-1d4d105c6433 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:04.763193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca737-09f1-445f-bba7-1d4d105c6433 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:04.763962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ca737-09f1-445f-bba7-1d4d105c6433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:04.782799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8f5ca737-09f1-445f-bba7-1d4d105c6433 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:04.784294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8f5ca737-09f1-445f-bba7-1d4d105c6433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:04.823259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb932fa2-afc4-44e5-8b41-ce20a598975d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:04.908090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 13/27] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:05.009415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2d063-eaab-4eaf-b77d-a636f2f18045 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:05.010154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2d063-eaab-4eaf-b77d-a636f2f18045 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:05.010738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2d063-eaab-4eaf-b77d-a636f2f18045 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:05.012612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 14/28] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:05.014965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb932fa2-afc4-44e5-8b41-ce20a598975d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:05.018548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb5bd2-f28e-4727-8a25-8603085a1c13 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:05.019067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb5bd2-f28e-4727-8a25-8603085a1c13 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:05.019540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb5bd2-f28e-4727-8a25-8603085a1c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:05.054427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0ccb5bd2-f28e-4727-8a25-8603085a1c13 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:05.056574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0ccb5bd2-f28e-4727-8a25-8603085a1c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:05.077887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df33a-2132-4040-902b-715d4b4e3b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:05.078464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df33a-2132-4040-902b-715d4b4e3b29 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:05.078810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df33a-2132-4040-902b-715d4b4e3b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:05.079084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8df33a-2132-4040-902b-715d4b4e3b29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:05.118010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8df33a-2132-4040-902b-715d4b4e3b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0d8df33a-2132-4040-902b-715d4b4e3b29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:05.123590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:05.124455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:05.125266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 15/29] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:05.134009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df33a-2132-4040-902b-715d4b4e3b29 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:05.142315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:05.160492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 15/30] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:05.161791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb5bd2-f28e-4727-8a25-8603085a1c13 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:05.239966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:05.330250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb5bd2-f28e-4727-8a25-8603085a1c13 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:05.369856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed408c9a-0db2-4aa7-a761-58760e417fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:05.370860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed408c9a-0db2-4aa7-a761-58760e417fae None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:05.371331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed408c9a-0db2-4aa7-a761-58760e417fae None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:05.371789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed408c9a-0db2-4aa7-a761-58760e417fae None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:05.372642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed408c9a-0db2-4aa7-a761-58760e417fae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:05.374455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed408c9a-0db2-4aa7-a761-58760e417fae None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:05.375223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8df33a-2132-4040-902b-715d4b4e3b29 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:05.477809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:05.478446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:05.478735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:05.479006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:05.479703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:05.480028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:05.481439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:05.500654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 16/31] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:05.501447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:05.528386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 16/32] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 31 05:05:05 2022] POST /identity/v3/roles => generated 219 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:05.529547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed408c9a-0db2-4aa7-a761-58760e417fae None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:05.590193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:05.649457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c076b1e-9265-4977-950d-502d4c2d80ab None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:05.696970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:05.698115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:05.698585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:05.700527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:05.719916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:05.721917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:05:05.751026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:05.751952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:05:05.752775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:05:05.752775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:05:05.752775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:05.753632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 17/33] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:05.754893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:05.779823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:05.788922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed408c9a-0db2-4aa7-a761-58760e417fae None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:05.848515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d5447-908d-4630-b832-5b4b626d057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:05.849195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d5447-908d-4630-b832-5b4b626d057e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:05.849576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d5447-908d-4630-b832-5b4b626d057e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:05.849857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d5447-908d-4630-b832-5b4b626d057e None admin] PATH_INFO: `/v3/users/08b48eac02ed4bf2b170e97ff2aa351b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:05.851702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d5447-908d-4630-b832-5b4b626d057e None admin] RBAC: Authorizing `identity:get_user(user_id=08b48eac02ed4bf2b170e97ff2aa351b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:05.853380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d5447-908d-4630-b832-5b4b626d057e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:05.856125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 17/34] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:05 2022] GET /identity/v3/users/08b48eac02ed4bf2b170e97ff2aa351b => generated 247 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:05.858499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d5447-908d-4630-b832-5b4b626d057e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:05.914800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a939598-e769-40f2-933f-71a62665d661 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:05.936135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:05.957661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052717cd-fa9b-4aa2-be0b-7438135472a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:05.958630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052717cd-fa9b-4aa2-be0b-7438135472a1 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:05.959084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052717cd-fa9b-4aa2-be0b-7438135472a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:05.959537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052717cd-fa9b-4aa2-be0b-7438135472a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:05.960677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052717cd-fa9b-4aa2-be0b-7438135472a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:05.963184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052717cd-fa9b-4aa2-be0b-7438135472a1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:05.988085 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d5447-908d-4630-b832-5b4b626d057e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:06.027714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e8664-dfb1-4041-8a9a-f5f078e10ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:06.028332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e8664-dfb1-4041-8a9a-f5f078e10ada None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.028614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e8664-dfb1-4041-8a9a-f5f078e10ada None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.028890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e8664-dfb1-4041-8a9a-f5f078e10ada None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.030925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e8664-dfb1-4041-8a9a-f5f078e10ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:06.031241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e8664-dfb1-4041-8a9a-f5f078e10ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:06.032780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e8664-dfb1-4041-8a9a-f5f078e10ada None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:06.052851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 18/35] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:06.052851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959be82-547c-4183-a604-93bd896712af None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.052851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959be82-547c-4183-a604-93bd896712af None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.052851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959be82-547c-4183-a604-93bd896712af None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.052851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:06.052851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959be82-547c-4183-a604-93bd896712af None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:06.082908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:06.100937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 31 05:05:05 2022] POST /identity/v3/roles => generated 225 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:06.103194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ea02a-3c99-4fe8-8c2f-8169de42225e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.103487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ea02a-3c99-4fe8-8c2f-8169de42225e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.103727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ea02a-3c99-4fe8-8c2f-8169de42225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.127160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e92ea02a-3c99-4fe8-8c2f-8169de42225e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:06.128849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e92ea02a-3c99-4fe8-8c2f-8169de42225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:06.200053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959be82-547c-4183-a604-93bd896712af None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:06.228885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 19/38] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:06.242234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ea02a-3c99-4fe8-8c2f-8169de42225e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:06.244761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae55eb-1904-45aa-885a-41bb98277f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:06.245608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae55eb-1904-45aa-885a-41bb98277f8f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.246015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae55eb-1904-45aa-885a-41bb98277f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.246469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae55eb-1904-45aa-885a-41bb98277f8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.249369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae55eb-1904-45aa-885a-41bb98277f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:06.253337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae55eb-1904-45aa-885a-41bb98277f8f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:06.255606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 20/39] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:06.257164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5df2-4509-4c8e-82ad-d8a62c1cae3e None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.257583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5df2-4509-4c8e-82ad-d8a62c1cae3e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.257886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5df2-4509-4c8e-82ad-d8a62c1cae3e None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.259499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 21/40] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:06.270849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eef21-f316-49cd-9300-55bbf95bb153 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.271132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eef21-f316-49cd-9300-55bbf95bb153 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.271416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302eef21-f316-49cd-9300-55bbf95bb153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.293914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-302eef21-f316-49cd-9300-55bbf95bb153 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:06.295476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-302eef21-f316-49cd-9300-55bbf95bb153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:06.382122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 22/41] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:06.382945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eef21-f316-49cd-9300-55bbf95bb153 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:06.396446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ea02a-3c99-4fe8-8c2f-8169de42225e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:06.410098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:06.417951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:06.442724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c9ce-43eb-4c41-b244-e5c555cf9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:06.443684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c9ce-43eb-4c41-b244-e5c555cf9192 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.443971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c9ce-43eb-4c41-b244-e5c555cf9192 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.444256 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36c9ce-43eb-4c41-b244-e5c555cf9192 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.444964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c9ce-43eb-4c41-b244-e5c555cf9192 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:06.447246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36c9ce-43eb-4c41-b244-e5c555cf9192 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:06.491409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 20/42] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:05:06 2022] POST /identity/v3/projects => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:06.529743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302eef21-f316-49cd-9300-55bbf95bb153 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:06.532293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c9ce-43eb-4c41-b244-e5c555cf9192 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:06.583627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2b3c0-1454-476f-b77f-a568adfc3af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:06.585022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2b3c0-1454-476f-b77f-a568adfc3af8 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.585545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2b3c0-1454-476f-b77f-a568adfc3af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.587042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2b3c0-1454-476f-b77f-a568adfc3af8 None admin] PATH_INFO: `/v3/domains/default/users/08b48eac02ed4bf2b170e97ff2aa351b/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.589413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2b3c0-1454-476f-b77f-a568adfc3af8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=08b48eac02ed4bf2b170e97ff2aa351b, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:06.591188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2b3c0-1454-476f-b77f-a568adfc3af8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:06.615828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Aug 31 05:05:06 2022] PUT /identity/v3/domains/default/users/08b48eac02ed4bf2b170e97ff2aa351b/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:06.688634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36c9ce-43eb-4c41-b244-e5c555cf9192 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:06.720015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2b3c0-1454-476f-b77f-a568adfc3af8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:06.728542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4ecf6-9dc5-418c-991b-2b802c936a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:06.729688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ecf6-9dc5-418c-991b-2b802c936a55 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.729688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ecf6-9dc5-418c-991b-2b802c936a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.729904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4ecf6-9dc5-418c-991b-2b802c936a55 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.730445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4ecf6-9dc5-418c-991b-2b802c936a55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:06.731857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4ecf6-9dc5-418c-991b-2b802c936a55 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:06.752398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 21/44] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 31 05:05:06 2022] POST /identity/v3/roles => generated 223 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:06.840585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:06.862821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2b3c0-1454-476f-b77f-a568adfc3af8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:06.918742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a03d6-6e14-4e3d-b41a-604b3db90c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:06.919404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a03d6-6e14-4e3d-b41a-604b3db90c09 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:06.919685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a03d6-6e14-4e3d-b41a-604b3db90c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:06.919962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a03d6-6e14-4e3d-b41a-604b3db90c09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:06.921152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a03d6-6e14-4e3d-b41a-604b3db90c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:06.922575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a03d6-6e14-4e3d-b41a-604b3db90c09 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:06.924436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 24/45] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:06.930486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4ecf6-9dc5-418c-991b-2b802c936a55 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:06.959998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:07.043227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4ecf6-9dc5-418c-991b-2b802c936a55 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:07.078115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f717ae-68c1-4016-9485-823c27b8d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:07.078731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f717ae-68c1-4016-9485-823c27b8d7f8 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:07.079012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f717ae-68c1-4016-9485-823c27b8d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:07.079281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f717ae-68c1-4016-9485-823c27b8d7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:07.079943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f717ae-68c1-4016-9485-823c27b8d7f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:07.081436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f717ae-68c1-4016-9485-823c27b8d7f8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:07.218965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 22/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:05:06 2022] POST /identity/v3/projects => generated 312 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:08.529139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26def-1609-4080-b0e3-9484aa5a9857 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:08.529676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26def-1609-4080-b0e3-9484aa5a9857 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:08.529676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26def-1609-4080-b0e3-9484aa5a9857 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:08.531097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 25/47] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:08.536674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2a66-a400-40ef-8fa9-3005e0717751 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:08.537160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2a66-a400-40ef-8fa9-3005e0717751 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:08.537246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc2a66-a400-40ef-8fa9-3005e0717751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:08.555777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fadc2a66-a400-40ef-8fa9-3005e0717751 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:08.556979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fadc2a66-a400-40ef-8fa9-3005e0717751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:08.626583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 23/48] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:08.886294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c26def-1609-4080-b0e3-9484aa5a9857 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:08.994087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c26def-1609-4080-b0e3-9484aa5a9857 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:09.029106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296289aa-4c39-4c81-8465-4ed7d497f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:09.029765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296289aa-4c39-4c81-8465-4ed7d497f289 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.030051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296289aa-4c39-4c81-8465-4ed7d497f289 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.030326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296289aa-4c39-4c81-8465-4ed7d497f289 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.042136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296289aa-4c39-4c81-8465-4ed7d497f289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-296289aa-4c39-4c81-8465-4ed7d497f289 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:09.048200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:09.049168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:09.049970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 26/49] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:09.055489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc2a66-a400-40ef-8fa9-3005e0717751 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:09.057808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:09.116847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f406d-0d19-4b78-9a0a-e09c813bb7c6 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.117150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f406d-0d19-4b78-9a0a-e09c813bb7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.117446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f406d-0d19-4b78-9a0a-e09c813bb7c6 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.118799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 27/50] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:09.123559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894eecc-bce6-4711-9fe7-1a5f76cd84ea None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.123845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894eecc-bce6-4711-9fe7-1a5f76cd84ea None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.124122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894eecc-bce6-4711-9fe7-1a5f76cd84ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.143440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b894eecc-bce6-4711-9fe7-1a5f76cd84ea None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:09.144564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b894eecc-bce6-4711-9fe7-1a5f76cd84ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:09.147694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:09.162535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc2a66-a400-40ef-8fa9-3005e0717751 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:09.197965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:09.198572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.198848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.199120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.199794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:09.200096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:09.201520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:09.210243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 24/51] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:09.215740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:09.217013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 28/52] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:09.275687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:09.312881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655eeeb-1e9b-4c61-bb1f-c5d6c69118c8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:09.346573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07097a98-8bd2-47c4-946d-7d15ef081c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:09.347207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07097a98-8bd2-47c4-946d-7d15ef081c1d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.347483 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07097a98-8bd2-47c4-946d-7d15ef081c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.347765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07097a98-8bd2-47c4-946d-7d15ef081c1d None admin] PATH_INFO: `/v3/users/08b48eac02ed4bf2b170e97ff2aa351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.349164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07097a98-8bd2-47c4-946d-7d15ef081c1d None admin] RBAC: Authorizing `identity:get_user(user_id=08b48eac02ed4bf2b170e97ff2aa351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:09.350646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07097a98-8bd2-47c4-946d-7d15ef081c1d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:09.352243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 25/53] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:09 2022] GET /identity/v3/users/08b48eac02ed4bf2b170e97ff2aa351b => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:09.357957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894eecc-bce6-4711-9fe7-1a5f76cd84ea None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:09.462072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894eecc-bce6-4711-9fe7-1a5f76cd84ea None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:09.480811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07097a98-8bd2-47c4-946d-7d15ef081c1d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:09.592649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07097a98-8bd2-47c4-946d-7d15ef081c1d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:09.604089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644b895-4e00-49f8-a449-1ff35a809ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:09.604730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644b895-4e00-49f8-a449-1ff35a809ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.605005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644b895-4e00-49f8-a449-1ff35a809ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.605309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644b895-4e00-49f8-a449-1ff35a809ed7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.606432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644b895-4e00-49f8-a449-1ff35a809ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:09.607893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644b895-4e00-49f8-a449-1ff35a809ed7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:09.609527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 29/54] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:09.615589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644b895-4e00-49f8-a449-1ff35a809ed7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:09.623964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:09.628038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:09.631016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5120-6642-4834-91a5-4256cf0d5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:09.632043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5120-6642-4834-91a5-4256cf0d5c1d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.632331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5120-6642-4834-91a5-4256cf0d5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.632817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5120-6642-4834-91a5-4256cf0d5c1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.634233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5120-6642-4834-91a5-4256cf0d5c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:09.635699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5120-6642-4834-91a5-4256cf0d5c1d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:09.637314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 26/55] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:09.643312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5120-6642-4834-91a5-4256cf0d5c1d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:09.724807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644b895-4e00-49f8-a449-1ff35a809ed7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:09.742213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5120-6642-4834-91a5-4256cf0d5c1d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:09.757629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875607f-e140-4a3c-8f3a-03b6a181129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:09.758250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875607f-e140-4a3c-8f3a-03b6a181129d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.758537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875607f-e140-4a3c-8f3a-03b6a181129d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.758811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875607f-e140-4a3c-8f3a-03b6a181129d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.759545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875607f-e140-4a3c-8f3a-03b6a181129d None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.domain.id=default, user.id=08b48eac02ed4bf2b170e97ff2aa351b) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:09.759852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875607f-e140-4a3c-8f3a-03b6a181129d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:09.761320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875607f-e140-4a3c-8f3a-03b6a181129d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:09.770468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 30/56] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Aug 31 05:05:09 2022] GET /identity/v3/role_assignments?user.id=08b48eac02ed4bf2b170e97ff2aa351b&scope.domain.id=default&role.id=6da07502c09e4fc8afb31b58e434479b => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:09.776310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147bc71e-09bc-4d50-a2c6-8c0b75d3802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:09.776941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bc71e-09bc-4d50-a2c6-8c0b75d3802c None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:09.777269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bc71e-09bc-4d50-a2c6-8c0b75d3802c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:09.777549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147bc71e-09bc-4d50-a2c6-8c0b75d3802c None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:09.778215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bc71e-09bc-4d50-a2c6-8c0b75d3802c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:09.779708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147bc71e-09bc-4d50-a2c6-8c0b75d3802c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:09.808481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 27/57] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Aug 31 05:05:09 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:05:11.690376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c396d-f079-4004-b686-7289292cd423 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:11.691123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c396d-f079-4004-b686-7289292cd423 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:11.691262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c396d-f079-4004-b686-7289292cd423 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:11.693564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 31/58] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:11.701342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794897c-2be4-4f62-930f-9253d924daba None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:11.701803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794897c-2be4-4f62-930f-9253d924daba None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:11.701891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794897c-2be4-4f62-930f-9253d924daba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:11.721643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9794897c-2be4-4f62-930f-9253d924daba None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:11.722877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9794897c-2be4-4f62-930f-9253d924daba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:11.772947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:11.800551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 28/59] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:12.069659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c396d-f079-4004-b686-7289292cd423 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:12.160512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:12.201607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c396d-f079-4004-b686-7289292cd423 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:12.236682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4c323-a8b1-465d-bee0-31bd01004cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:12.237327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c323-a8b1-465d-bee0-31bd01004cbd None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:12.237604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c323-a8b1-465d-bee0-31bd01004cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:12.237878 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4c323-a8b1-465d-bee0-31bd01004cbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:12.239099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4c323-a8b1-465d-bee0-31bd01004cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:12.240544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4c323-a8b1-465d-bee0-31bd01004cbd None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:12.242139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 32/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:12.247855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794897c-2be4-4f62-930f-9253d924daba None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:12.360845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794897c-2be4-4f62-930f-9253d924daba None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:12.400682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fac76d-135e-473f-8b25-216c0f27926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:12.401321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fac76d-135e-473f-8b25-216c0f27926e None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:12.401602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fac76d-135e-473f-8b25-216c0f27926e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:12.401872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fac76d-135e-473f-8b25-216c0f27926e None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:12.402518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fac76d-135e-473f-8b25-216c0f27926e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:12.403962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fac76d-135e-473f-8b25-216c0f27926e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:12.433705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 29/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:05:12 2022] POST /identity/v3/users => generated 275 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:15.530663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241eb47-1cc9-4a93-8e8b-ad4e68961635 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:15.531517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241eb47-1cc9-4a93-8e8b-ad4e68961635 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:15.531959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241eb47-1cc9-4a93-8e8b-ad4e68961635 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:15.533496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 33/62] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:15.539266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ede7-3895-4931-a14d-de136a137e75 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:15.540044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ede7-3895-4931-a14d-de136a137e75 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:15.540462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ede7-3895-4931-a14d-de136a137e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:15.570141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-df55ede7-3895-4931-a14d-de136a137e75 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:15.571585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-df55ede7-3895-4931-a14d-de136a137e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:15.611213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:15.647958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8444485-86be-41fb-9955-93446ae0a980 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:15.648303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8444485-86be-41fb-9955-93446ae0a980 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:15.648510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8444485-86be-41fb-9955-93446ae0a980 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:15.649888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 34/63] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:15.664208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c8b06-bace-4264-82fd-735b3b62bbc2 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:15.664491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c8b06-bace-4264-82fd-735b3b62bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:15.664764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c8b06-bace-4264-82fd-735b3b62bbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:15.680221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 30/64] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:15.690652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-224c8b06-bace-4264-82fd-735b3b62bbc2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:15.692107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-224c8b06-bace-4264-82fd-735b3b62bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:15.744955 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2e6b0-f6b6-4045-92ad-259fd2183f1d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:15.745615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2e6b0-f6b6-4045-92ad-259fd2183f1d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:15.746112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2e6b0-f6b6-4045-92ad-259fd2183f1d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:15.747754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 31/65] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:15.753422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510ccf-546b-4a0a-bc79-4b10cd33d2c5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:15.754204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510ccf-546b-4a0a-bc79-4b10cd33d2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:15.754885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88510ccf-546b-4a0a-bc79-4b10cd33d2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:15.784689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-88510ccf-546b-4a0a-bc79-4b10cd33d2c5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:15.786717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-88510ccf-546b-4a0a-bc79-4b10cd33d2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:15.803800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 35/66] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:15.887273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 32/67] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:15.945740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c8b06-bace-4264-82fd-735b3b62bbc2 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.028705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226f9a1-5b92-4050-8dc1-8d6c6df4f2fc None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.029005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226f9a1-5b92-4050-8dc1-8d6c6df4f2fc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.029290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226f9a1-5b92-4050-8dc1-8d6c6df4f2fc None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.030654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 33/68] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:16.034750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:16.039325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f44b-d4d9-4fa9-93e8-c31da8d64c2e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.039960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f44b-d4d9-4fa9-93e8-c31da8d64c2e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.040464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536f44b-d4d9-4fa9-93e8-c31da8d64c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.068787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f536f44b-d4d9-4fa9-93e8-c31da8d64c2e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:16.071128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f536f44b-d4d9-4fa9-93e8-c31da8d64c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:16.078828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c8b06-bace-4264-82fd-735b3b62bbc2 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.113779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee511ca-de88-46b9-9ac9-640f786e8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.114911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee511ca-de88-46b9-9ac9-640f786e8482 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.115327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee511ca-de88-46b9-9ac9-640f786e8482 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.115730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee511ca-de88-46b9-9ac9-640f786e8482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.125818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee511ca-de88-46b9-9ac9-640f786e8482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-2ee511ca-de88-46b9-9ac9-640f786e8482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:16.131087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:16.131985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:16.132782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:16.138377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 36/69] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:16.138377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9180f-315b-47bf-b6ae-4c62dd531887 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.138377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9180f-315b-47bf-b6ae-4c62dd531887 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.138377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9180f-315b-47bf-b6ae-4c62dd531887 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.138984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 37/70] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:16.140241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9180f-315b-47bf-b6ae-4c62dd531887 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.154982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 34/71] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:16.156130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f44b-d4d9-4fa9-93e8-c31da8d64c2e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.185015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:16.262827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536f44b-d4d9-4fa9-93e8-c31da8d64c2e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.264127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9180f-315b-47bf-b6ae-4c62dd531887 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.293418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:16.299638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fb6b1-4f5f-4c7d-b50a-f6534b942d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.300304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fb6b1-4f5f-4c7d-b50a-f6534b942d62 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.300586 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fb6b1-4f5f-4c7d-b50a-f6534b942d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.300883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fb6b1-4f5f-4c7d-b50a-f6534b942d62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.302596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679598-b015-4a56-b679-9ef90504f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.303222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679598-b015-4a56-b679-9ef90504f91d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.303503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679598-b015-4a56-b679-9ef90504f91d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.303784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679598-b015-4a56-b679-9ef90504f91d None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.304454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679598-b015-4a56-b679-9ef90504f91d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:16.304755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679598-b015-4a56-b679-9ef90504f91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:16.306186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679598-b015-4a56-b679-9ef90504f91d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:16.312260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fb6b1-4f5f-4c7d-b50a-f6534b942d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:16.314583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 35/72] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-f51fb6b1-4f5f-4c7d-b50a-f6534b942d62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:16.317712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:16.318627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:16.319672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:16.320519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 38/73] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:16.320722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47b86c-5642-4eb5-84cb-ffb974d314b6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.320803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47b86c-5642-4eb5-84cb-ffb974d314b6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.321019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47b86c-5642-4eb5-84cb-ffb974d314b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.321306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fb6b1-4f5f-4c7d-b50a-f6534b942d62 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.344165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-df47b86c-5642-4eb5-84cb-ffb974d314b6 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:16.345818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-df47b86c-5642-4eb5-84cb-ffb974d314b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:16.416137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 36/74] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:16.416899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47b86c-5642-4eb5-84cb-ffb974d314b6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.432074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fb6b1-4f5f-4c7d-b50a-f6534b942d62 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.447846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:16.467612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc344dc-9478-437a-8a3c-bd8ba159ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.468655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc344dc-9478-437a-8a3c-bd8ba159ad01 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.468950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc344dc-9478-437a-8a3c-bd8ba159ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.469259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc344dc-9478-437a-8a3c-bd8ba159ad01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.480829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc344dc-9478-437a-8a3c-bd8ba159ad01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-8cc344dc-9478-437a-8a3c-bd8ba159ad01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:16.485669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:16.486528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 39/75] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:16.492295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc344dc-9478-437a-8a3c-bd8ba159ad01 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.537492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47b86c-5642-4eb5-84cb-ffb974d314b6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.542616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:16.580565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9a01-d78e-424b-8a08-ab39b1f51e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.581289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9a01-d78e-424b-8a08-ab39b1f51e4f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.581574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9a01-d78e-424b-8a08-ab39b1f51e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.582504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9a01-d78e-424b-8a08-ab39b1f51e4f None admin] PATH_INFO: `/v3/users/08b48eac02ed4bf2b170e97ff2aa351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.583922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf9a01-d78e-424b-8a08-ab39b1f51e4f None admin] RBAC: Authorizing `identity:get_user(user_id=08b48eac02ed4bf2b170e97ff2aa351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:16.586276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf9a01-d78e-424b-8a08-ab39b1f51e4f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:16.588801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 37/76] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/users/08b48eac02ed4bf2b170e97ff2aa351b => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:16.589687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9a01-d78e-424b-8a08-ab39b1f51e4f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.595989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc344dc-9478-437a-8a3c-bd8ba159ad01 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.632456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.633188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.633472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.633748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.635006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:16.635006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:16.636109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:16.653777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 40/77] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:16.653777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.698296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:16.711570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9a01-d78e-424b-8a08-ab39b1f51e4f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.745665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c18ae-1e5b-411e-958e-91bcc46ccf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.746305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c18ae-1e5b-411e-958e-91bcc46ccf53 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.746587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c18ae-1e5b-411e-958e-91bcc46ccf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.746866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c18ae-1e5b-411e-958e-91bcc46ccf53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.750522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599a1d-b1cb-473f-abbb-07926fcfedd3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.757292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c18ae-1e5b-411e-958e-91bcc46ccf53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1b2c18ae-1e5b-411e-958e-91bcc46ccf53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:16.762144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:16.763094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:16.764267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 38/78] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:16.765001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:16.769541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c18ae-1e5b-411e-958e-91bcc46ccf53 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.786809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.787440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.787725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.788003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.788689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:16.788993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:16.790426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:16.798303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 41/79] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:16.799088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.870373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c18ae-1e5b-411e-958e-91bcc46ccf53 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.899626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7140c0-da77-4609-bba5-a10076161eb9 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:16.904511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957bad7-cad2-43ab-85b4-6fd21ce52804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.905147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957bad7-cad2-43ab-85b4-6fd21ce52804 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.905438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957bad7-cad2-43ab-85b4-6fd21ce52804 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.905716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957bad7-cad2-43ab-85b4-6fd21ce52804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.923716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:16.932858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5aff6-e564-42f2-97eb-b8924f5d6e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:16.933522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5aff6-e564-42f2-97eb-b8924f5d6e92 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:16.933807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5aff6-e564-42f2-97eb-b8924f5d6e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:16.934086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5aff6-e564-42f2-97eb-b8924f5d6e92 None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:16.948914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5aff6-e564-42f2-97eb-b8924f5d6e92 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:16.950385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5aff6-e564-42f2-97eb-b8924f5d6e92 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:16.952021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 42/80] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:16.952780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5aff6-e564-42f2-97eb-b8924f5d6e92 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:16.978448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957bad7-cad2-43ab-85b4-6fd21ce52804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:16.979950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957bad7-cad2-43ab-85b4-6fd21ce52804 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:16.983825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.058367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5aff6-e564-42f2-97eb-b8924f5d6e92 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.078550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 39/81] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:17.079390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957bad7-cad2-43ab-85b4-6fd21ce52804 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.092163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fa524-b346-44b2-9826-6247d8bd6353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.092808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fa524-b346-44b2-9826-6247d8bd6353 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.093119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fa524-b346-44b2-9826-6247d8bd6353 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.093397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fa524-b346-44b2-9826-6247d8bd6353 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.094601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fa524-b346-44b2-9826-6247d8bd6353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.096041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fa524-b346-44b2-9826-6247d8bd6353 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.097617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 43/82] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:17.101380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fa524-b346-44b2-9826-6247d8bd6353 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.134657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.185475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957bad7-cad2-43ab-85b4-6fd21ce52804 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.193786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.196999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fa524-b346-44b2-9826-6247d8bd6353 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.220708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.221366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.221656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.221927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.222601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:17.223057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.224471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.230650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cda41-748f-4caf-9469-dfff0bf2ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.231302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cda41-748f-4caf-9469-dfff0bf2ef4d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.231584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cda41-748f-4caf-9469-dfff0bf2ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.231860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cda41-748f-4caf-9469-dfff0bf2ef4d None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.237109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 40/83] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:17.237251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cda41-748f-4caf-9469-dfff0bf2ef4d None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.237331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.237401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cda41-748f-4caf-9469-dfff0bf2ef4d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.237401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 44/84] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:17.237401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cda41-748f-4caf-9469-dfff0bf2ef4d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.339088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cda41-748f-4caf-9469-dfff0bf2ef4d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.340271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec5cc-9de9-4953-99b5-dadb5640b1bd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.350852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.373757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279261-8b17-4c1c-820b-974daea9d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.374370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279261-8b17-4c1c-820b-974daea9d20b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.374650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279261-8b17-4c1c-820b-974daea9d20b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.374925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279261-8b17-4c1c-820b-974daea9d20b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.375551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185244-0a01-4212-89d8-81406c2b0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.376193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185244-0a01-4212-89d8-81406c2b0bdf None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.376476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185244-0a01-4212-89d8-81406c2b0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.376750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4185244-0a01-4212-89d8-81406c2b0bdf None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.377941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4185244-0a01-4212-89d8-81406c2b0bdf None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.379473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4185244-0a01-4212-89d8-81406c2b0bdf None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.381346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 45/85] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:17.381881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185244-0a01-4212-89d8-81406c2b0bdf None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.420002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.443138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c279261-8b17-4c1c-820b-974daea9d20b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.444619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c279261-8b17-4c1c-820b-974daea9d20b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.487732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4185244-0a01-4212-89d8-81406c2b0bdf None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.523457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e3275-70d7-4b21-8e79-800cd692fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.524090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e3275-70d7-4b21-8e79-800cd692fe3c None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.524376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e3275-70d7-4b21-8e79-800cd692fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.524653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e3275-70d7-4b21-8e79-800cd692fe3c None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.525340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e3275-70d7-4b21-8e79-800cd692fe3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.526786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e3275-70d7-4b21-8e79-800cd692fe3c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.542883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 41/86] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:17.543579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279261-8b17-4c1c-820b-974daea9d20b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.555936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.559691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 46/87] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:05:17 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:17.560609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e3275-70d7-4b21-8e79-800cd692fe3c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.665389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279261-8b17-4c1c-820b-974daea9d20b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.672562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.685514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e3275-70d7-4b21-8e79-800cd692fe3c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.704185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9f55-c1b5-4afc-87d9-964636ea5aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.704840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9f55-c1b5-4afc-87d9-964636ea5aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.705153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9f55-c1b5-4afc-87d9-964636ea5aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.705434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9f55-c1b5-4afc-87d9-964636ea5aa2 None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.706580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9f55-c1b5-4afc-87d9-964636ea5aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.708545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9f55-c1b5-4afc-87d9-964636ea5aa2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.709958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 42/88] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:17.714802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9f55-c1b5-4afc-87d9-964636ea5aa2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.724834 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242e4e-0658-47c3-9f3d-c3f8e5d2ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.726138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242e4e-0658-47c3-9f3d-c3f8e5d2ee7b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.726601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242e4e-0658-47c3-9f3d-c3f8e5d2ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.727355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242e4e-0658-47c3-9f3d-c3f8e5d2ee7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.810843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.814076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45242e4e-0658-47c3-9f3d-c3f8e5d2ee7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.815458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45242e4e-0658-47c3-9f3d-c3f8e5d2ee7b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.845150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9f55-c1b5-4afc-87d9-964636ea5aa2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:17.883267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:17.884234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:17.884728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:17.885119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:17.886012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=01eefcc996554d09bd94843c0e1e6685, user.id=08b48eac02ed4bf2b170e97ff2aa351b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:17.886425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:17.887982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:17.896667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 43/89] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/role_assignments?user.id=08b48eac02ed4bf2b170e97ff2aa351b&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=6da07502c09e4fc8afb31b58e434479b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:17.897546 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:17.931398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:17.944665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 47/90] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:17.950168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242e4e-0658-47c3-9f3d-c3f8e5d2ee7b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:18.108621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6559c1-5bef-431f-a28f-bd8d0514a79a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:18.127551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242e4e-0658-47c3-9f3d-c3f8e5d2ee7b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:18.146855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c5d3b-9aec-4600-9a12-3986feacfb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:18.147855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c5d3b-9aec-4600-9a12-3986feacfb49 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:18.148356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c5d3b-9aec-4600-9a12-3986feacfb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:18.148825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c5d3b-9aec-4600-9a12-3986feacfb49 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:18.150237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c5d3b-9aec-4600-9a12-3986feacfb49 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:18.151927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c5d3b-9aec-4600-9a12-3986feacfb49 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:18.154195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 44/91] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:18.155333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c5d3b-9aec-4600-9a12-3986feacfb49 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:18.167223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4a7c9-4e0b-4716-b5f0-9249872eca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:18.167662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a7c9-4e0b-4716-b5f0-9249872eca80 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:18.167944 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a7c9-4e0b-4716-b5f0-9249872eca80 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:18.168278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4a7c9-4e0b-4716-b5f0-9249872eca80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:18.171839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:18.278631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:18.296735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c5d3b-9aec-4600-9a12-3986feacfb49 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:18.313941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4a7c9-4e0b-4716-b5f0-9249872eca80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:18.315441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4a7c9-4e0b-4716-b5f0-9249872eca80 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:18.358430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569808b3-18ac-44bb-a0ee-abe5b0e84950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:18.359451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569808b3-18ac-44bb-a0ee-abe5b0e84950 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:18.359951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569808b3-18ac-44bb-a0ee-abe5b0e84950 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:18.360442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569808b3-18ac-44bb-a0ee-abe5b0e84950 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:18.361812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569808b3-18ac-44bb-a0ee-abe5b0e84950 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:18.363534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569808b3-18ac-44bb-a0ee-abe5b0e84950 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:18.373591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 45/92] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:18 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:18.374773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569808b3-18ac-44bb-a0ee-abe5b0e84950 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:18.421334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 48/93] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:18.422007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4a7c9-4e0b-4716-b5f0-9249872eca80 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:18.540915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4a7c9-4e0b-4716-b5f0-9249872eca80 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:18.552122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:18.555853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:18.577543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:18.578255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:18.578696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:18.579109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:18.579990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] RBAC: Adding query filter params (role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=01eefcc996554d09bd94843c0e1e6685, user.id=6ec03fbc1019458b83bcc0af6fb04ad9) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:18.580469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:18.582258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:18.588552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 49/94] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:18 2022] GET /identity/v3/role_assignments?user.id=6ec03fbc1019458b83bcc0af6fb04ad9&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:18.589640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:18.631381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569808b3-18ac-44bb-a0ee-abe5b0e84950 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:18.716445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:18.717066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:18.717366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:18.717646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:18.718396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] RBAC: Adding query filter params (role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=01eefcc996554d09bd94843c0e1e6685, user.id=6ec03fbc1019458b83bcc0af6fb04ad9) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:18.718711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:18.720195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:18.732757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 46/95] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:18 2022] GET /identity/v3/role_assignments?user.id=6ec03fbc1019458b83bcc0af6fb04ad9&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 259 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:18.744316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72e21-e215-46ac-9fb0-5b58bf19c3b2 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:18.788097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e55f7a-d3b8-4ef9-8a58-cf1a29b838f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:18.789015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e55f7a-d3b8-4ef9-8a58-cf1a29b838f1 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:18.789654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e55f7a-d3b8-4ef9-8a58-cf1a29b838f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:18.790076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e55f7a-d3b8-4ef9-8a58-cf1a29b838f1 None admin] PATH_INFO: `/v3/projects/7922e4410a1e4072ac0058c9c6dd6a3c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:18.791517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e55f7a-d3b8-4ef9-8a58-cf1a29b838f1 None admin] RBAC: Authorizing `identity:get_project(project_id=7922e4410a1e4072ac0058c9c6dd6a3c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:18.793250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e55f7a-d3b8-4ef9-8a58-cf1a29b838f1 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:18.795164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 50/96] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:18 2022] GET /identity/v3/projects/7922e4410a1e4072ac0058c9c6dd6a3c => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:18.801283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:18.958400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe652fb-6c60-40cd-889d-4475462414ef None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:19.010279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb9822-628e-4f75-822f-1a0b60b29733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:19.011326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9822-628e-4f75-822f-1a0b60b29733 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:19.011765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9822-628e-4f75-822f-1a0b60b29733 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:19.012227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb9822-628e-4f75-822f-1a0b60b29733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:19.013070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb9822-628e-4f75-822f-1a0b60b29733 None admin] RBAC: Adding query filter params (role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=7922e4410a1e4072ac0058c9c6dd6a3c, user.id=6ec03fbc1019458b83bcc0af6fb04ad9) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:19.013434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb9822-628e-4f75-822f-1a0b60b29733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:19.015195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb9822-628e-4f75-822f-1a0b60b29733 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:19.025450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 47/97] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:18 2022] GET /identity/v3/role_assignments?user.id=6ec03fbc1019458b83bcc0af6fb04ad9&scope.project.id=7922e4410a1e4072ac0058c9c6dd6a3c&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:19.973046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dccfc-a343-498e-a2a5-cecd18b84f2c None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:19.973046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dccfc-a343-498e-a2a5-cecd18b84f2c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:19.973046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dccfc-a343-498e-a2a5-cecd18b84f2c None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:19.974178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 51/98] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:19.978260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa39b4-71e8-49f6-b5a2-7695aa13c2ab None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:19.979050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa39b4-71e8-49f6-b5a2-7695aa13c2ab None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:19.979536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa39b4-71e8-49f6-b5a2-7695aa13c2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:19.997782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:20.007519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b6fa39b4-71e8-49f6-b5a2-7695aa13c2ab None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:20.009039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b6fa39b4-71e8-49f6-b5a2-7695aa13c2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:20.100426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 48/99] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:20.159460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d600f99-51be-4fdb-8c53-ebf3d0a4f080 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:20.160068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d600f99-51be-4fdb-8c53-ebf3d0a4f080 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:20.160650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d600f99-51be-4fdb-8c53-ebf3d0a4f080 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:20.162465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 52/100] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:20.168084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f23f1-0c58-45b7-b642-f0ca1fc8994c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:20.168614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f23f1-0c58-45b7-b642-f0ca1fc8994c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:20.169102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f23f1-0c58-45b7-b642-f0ca1fc8994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:20.191164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-056f23f1-0c58-45b7-b642-f0ca1fc8994c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:20.192730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-056f23f1-0c58-45b7-b642-f0ca1fc8994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:20.275750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 49/101] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:20.522044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d600f99-51be-4fdb-8c53-ebf3d0a4f080 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:20.553618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:20.615950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b486a94-ade1-4174-94a1-147308151f3f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:20.616253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b486a94-ade1-4174-94a1-147308151f3f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:20.616516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b486a94-ade1-4174-94a1-147308151f3f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:20.619864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 50/102] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:20.628379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467e332-21e6-4bb1-bc5a-82938f2239b9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:20.628379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467e332-21e6-4bb1-bc5a-82938f2239b9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:20.628379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467e332-21e6-4bb1-bc5a-82938f2239b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:20.659433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1467e332-21e6-4bb1-bc5a-82938f2239b9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:20.660735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1467e332-21e6-4bb1-bc5a-82938f2239b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:20.681879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d600f99-51be-4fdb-8c53-ebf3d0a4f080 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:20.734356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d1b1-954d-4183-b49d-748bb340d933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:20.735307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d1b1-954d-4183-b49d-748bb340d933 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:20.735770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d1b1-954d-4183-b49d-748bb340d933 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:20.736213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d1b1-954d-4183-b49d-748bb340d933 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:20.759231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439d1b1-954d-4183-b49d-748bb340d933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-e439d1b1-954d-4183-b49d-748bb340d933 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:20.765654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:20.766517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:20.767324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:20.769677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 53/103] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:20.770763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d1b1-954d-4183-b49d-748bb340d933 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:20.771619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:20.790443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 51/104] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:20.791327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467e332-21e6-4bb1-bc5a-82938f2239b9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:20.889138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:20.908874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d1b1-954d-4183-b49d-748bb340d933 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:20.964668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07e43e-4cf9-4ded-90b8-65fb43c05357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:20.965341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07e43e-4cf9-4ded-90b8-65fb43c05357 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:20.965628 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07e43e-4cf9-4ded-90b8-65fb43c05357 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:20.965896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07e43e-4cf9-4ded-90b8-65fb43c05357 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:20.969755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07e43e-4cf9-4ded-90b8-65fb43c05357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:20.971213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07e43e-4cf9-4ded-90b8-65fb43c05357 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:20.972865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 54/105] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:20.978699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07e43e-4cf9-4ded-90b8-65fb43c05357 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:20.983558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467e332-21e6-4bb1-bc5a-82938f2239b9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:21.085219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:21.085219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:21.085219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:21.085219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:21.085634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:21.085634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:21.085634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:21.101129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 52/106] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:21.117194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:21.141826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07e43e-4cf9-4ded-90b8-65fb43c05357 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:21.178679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e049317-e6b6-44f6-beb0-c71996cd56b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:21.179653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049317-e6b6-44f6-beb0-c71996cd56b1 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:21.180163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049317-e6b6-44f6-beb0-c71996cd56b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:21.180640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049317-e6b6-44f6-beb0-c71996cd56b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:21.181547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e049317-e6b6-44f6-beb0-c71996cd56b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:21.183312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e049317-e6b6-44f6-beb0-c71996cd56b1 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:21.224221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 55/107] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:05:20 2022] POST /identity/v3/projects => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:21.262784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:21.326411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51790843-4427-4214-b373-d60284cc7f25 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:21.373273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1ab25-12ba-4517-80b5-58e7bd72fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:21.373939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ab25-12ba-4517-80b5-58e7bd72fb86 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:21.374221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ab25-12ba-4517-80b5-58e7bd72fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:21.374496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ab25-12ba-4517-80b5-58e7bd72fb86 None admin] PATH_INFO: `/v3/users/00095bd11d8244ebb8690f46d7ec553b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:21.381555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e049317-e6b6-44f6-beb0-c71996cd56b1 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:21.387338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:21.395457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1ab25-12ba-4517-80b5-58e7bd72fb86 None admin] RBAC: Authorizing `identity:get_user(user_id=00095bd11d8244ebb8690f46d7ec553b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:21.396904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1ab25-12ba-4517-80b5-58e7bd72fb86 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:21.399070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 53/108] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:21 2022] GET /identity/v3/users/00095bd11d8244ebb8690f46d7ec553b => generated 289 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:21.406853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1ab25-12ba-4517-80b5-58e7bd72fb86 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:21.512606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e049317-e6b6-44f6-beb0-c71996cd56b1 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:21.543800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1ab25-12ba-4517-80b5-58e7bd72fb86 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:21.557064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4f6d-2266-42fa-b438-5417e0eb8387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:21.558073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4f6d-2266-42fa-b438-5417e0eb8387 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:21.558576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4f6d-2266-42fa-b438-5417e0eb8387 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:21.559114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4f6d-2266-42fa-b438-5417e0eb8387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:21.565828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:21.573336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c4f6d-2266-42fa-b438-5417e0eb8387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-7e4c4f6d-2266-42fa-b438-5417e0eb8387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:21.581336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:21.582306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:21.583087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:21.585749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 56/109] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:21.589888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aab68-fc2b-4886-9156-44c7bdc98e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:21.590619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aab68-fc2b-4886-9156-44c7bdc98e8a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:21.590966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aab68-fc2b-4886-9156-44c7bdc98e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:21.591307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aab68-fc2b-4886-9156-44c7bdc98e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:21.594700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4f6d-2266-42fa-b438-5417e0eb8387 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:21.673078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:21.680246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aab68-fc2b-4886-9156-44c7bdc98e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:21.682040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aab68-fc2b-4886-9156-44c7bdc98e8a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:21.720804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4f6d-2266-42fa-b438-5417e0eb8387 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:21.768611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:21.771689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:21.773447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:21.774810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:21.777007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:21.777604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:21.780167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:21.798120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 57/110] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:21.805214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:21.818592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 54/111] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:21.827779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aab68-fc2b-4886-9156-44c7bdc98e8a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:21.859132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:21.965562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcaeb92-a3a5-4fc2-af79-d6fe61a1b768 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:21.969418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aab68-fc2b-4886-9156-44c7bdc98e8a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:21.994460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:22.003840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e0db5-0ad1-445f-9823-acf432491c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:22.004568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e0db5-0ad1-445f-9823-acf432491c52 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.004854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e0db5-0ad1-445f-9823-acf432491c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.005195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e0db5-0ad1-445f-9823-acf432491c52 None admin] PATH_INFO: `/v3/users/08b48eac02ed4bf2b170e97ff2aa351b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.006474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e0db5-0ad1-445f-9823-acf432491c52 None admin] RBAC: Authorizing `identity:get_user(user_id=08b48eac02ed4bf2b170e97ff2aa351b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:22.007832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e0db5-0ad1-445f-9823-acf432491c52 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:22.009469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 58/112] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:21 2022] GET /identity/v3/users/08b48eac02ed4bf2b170e97ff2aa351b => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:22.014317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322d2e-f5e2-47b8-bfd4-7236b9fbe12a None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.014317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322d2e-f5e2-47b8-bfd4-7236b9fbe12a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.014317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322d2e-f5e2-47b8-bfd4-7236b9fbe12a None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.014317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 59/113] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:22.014317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328cf54-cb38-4c69-b5fe-61d92c60fc15 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.014317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328cf54-cb38-4c69-b5fe-61d92c60fc15 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.014670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328cf54-cb38-4c69-b5fe-61d92c60fc15 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.015818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 60/114] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:22.016715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7657e-c152-4251-b7b6-5d00934a5d25 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.017120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7657e-c152-4251-b7b6-5d00934a5d25 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.017399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7657e-c152-4251-b7b6-5d00934a5d25 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.018580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 61/115] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:22.019276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7657e-c152-4251-b7b6-5d00934a5d25 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:22.019672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf02830-f004-467d-b08d-ef859191b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:22.020658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf02830-f004-467d-b08d-ef859191b930 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.020975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf02830-f004-467d-b08d-ef859191b930 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.021280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf02830-f004-467d-b08d-ef859191b930 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.025837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf02830-f004-467d-b08d-ef859191b930 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:22.027549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf02830-f004-467d-b08d-ef859191b930 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:22.029632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 55/116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:21 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:22.031589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103135-6041-40a2-88b1-a471ea805778 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.032533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103135-6041-40a2-88b1-a471ea805778 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.033006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103135-6041-40a2-88b1-a471ea805778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.055845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ff103135-6041-40a2-88b1-a471ea805778 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:22.057061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ff103135-6041-40a2-88b1-a471ea805778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:22.125368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7657e-c152-4251-b7b6-5d00934a5d25 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:22.137989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 56/117] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:22.140404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799227-fafd-4241-8fc9-ffb4a3f03297 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.141020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799227-fafd-4241-8fc9-ffb4a3f03297 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.141644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799227-fafd-4241-8fc9-ffb4a3f03297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.160458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1053-30d8-459b-8837-3616f8fd94d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:22.161250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1053-30d8-459b-8837-3616f8fd94d5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.161643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1053-30d8-459b-8837-3616f8fd94d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.161988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1053-30d8-459b-8837-3616f8fd94d5 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.163200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb1053-30d8-459b-8837-3616f8fd94d5 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:22.164707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb1053-30d8-459b-8837-3616f8fd94d5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:22.171030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 62/118] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:22 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:22.171030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002603-8549-4a4c-ade8-71cd8c9ffc0c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.171030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002603-8549-4a4c-ade8-71cd8c9ffc0c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.171030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002603-8549-4a4c-ade8-71cd8c9ffc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.172832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-58799227-fafd-4241-8fc9-ffb4a3f03297 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:22.174293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-58799227-fafd-4241-8fc9-ffb4a3f03297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:22.187673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fa002603-8549-4a4c-ade8-71cd8c9ffc0c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:22.189453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:22.189584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fa002603-8549-4a4c-ade8-71cd8c9ffc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:22.254332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:22.266983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 63/119] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:22.267905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002603-8549-4a4c-ade8-71cd8c9ffc0c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:22.269037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 57/120] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:22.270113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58799227-fafd-4241-8fc9-ffb4a3f03297 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:22.377550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002603-8549-4a4c-ade8-71cd8c9ffc0c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:22.404749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58799227-fafd-4241-8fc9-ffb4a3f03297 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:22.416212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:22.416955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.417509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.417809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.418696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] RBAC: Adding query filter params (role.id=48a551b7e05445ceb37de851862f0cc8, scope.project.id=01eefcc996554d09bd94843c0e1e6685, user.id=00095bd11d8244ebb8690f46d7ec553b) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:22.419111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:22.420689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:22.427189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 64/121] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:22 2022] GET /identity/v3/role_assignments?user.id=00095bd11d8244ebb8690f46d7ec553b&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=48a551b7e05445ceb37de851862f0cc8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:22.448725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520ced-d738-43bf-9526-ef14f6869a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:22.449708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520ced-d738-43bf-9526-ef14f6869a1b None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520ced-d738-43bf-9526-ef14f6869a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.450593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520ced-d738-43bf-9526-ef14f6869a1b None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685/users/08b48eac02ed4bf2b170e97ff2aa351b/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.452881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7520ced-d738-43bf-9526-ef14f6869a1b None admin] RBAC: Authorizing `identity:create_grant(project_id=01eefcc996554d09bd94843c0e1e6685, user_id=08b48eac02ed4bf2b170e97ff2aa351b, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:22.454655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7520ced-d738-43bf-9526-ef14f6869a1b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:22.483921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 58/122] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:22 2022] PUT /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685/users/08b48eac02ed4bf2b170e97ff2aa351b/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:22.586762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:22.635877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520ced-d738-43bf-9526-ef14f6869a1b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:22.643582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:22.668651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:22.745695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3973644-9dda-4d77-84b3-052e732b124c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:22.782583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40128d2f-6cb4-4d8c-9dff-33f0810d6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:22.783235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128d2f-6cb4-4d8c-9dff-33f0810d6a85 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.783520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128d2f-6cb4-4d8c-9dff-33f0810d6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.783961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128d2f-6cb4-4d8c-9dff-33f0810d6a85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.795577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40128d2f-6cb4-4d8c-9dff-33f0810d6a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-40128d2f-6cb4-4d8c-9dff-33f0810d6a85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:22.801165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:22.802046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:22.802829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 65/123] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:22.803479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40128d2f-6cb4-4d8c-9dff-33f0810d6a85 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:22.814855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520ced-d738-43bf-9526-ef14f6869a1b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:22.852386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaea29a-e4ab-4186-a861-4a12a4ac32a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:22.853447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea29a-e4ab-4186-a861-4a12a4ac32a1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.853949 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea29a-e4ab-4186-a861-4a12a4ac32a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.854408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaea29a-e4ab-4186-a861-4a12a4ac32a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.865941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaea29a-e4ab-4186-a861-4a12a4ac32a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0aaea29a-e4ab-4186-a861-4a12a4ac32a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:22.871528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:22.872397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:22.873184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:22.875499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 59/124] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:22.876463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaea29a-e4ab-4186-a861-4a12a4ac32a1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:22.911642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40128d2f-6cb4-4d8c-9dff-33f0810d6a85 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:22.929292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:22.946550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:22.949117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ad30-7c14-480b-a8dc-156897d1fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:22.949785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ad30-7c14-480b-a8dc-156897d1fd84 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:22.950115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ad30-7c14-480b-a8dc-156897d1fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:22.950402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5ad30-7c14-480b-a8dc-156897d1fd84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:22.968009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5ad30-7c14-480b-a8dc-156897d1fd84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-b7d5ad30-7c14-480b-a8dc-156897d1fd84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:22.974886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:22.975802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:22.976594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:22.979708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 66/125] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:22.980512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ad30-7c14-480b-a8dc-156897d1fd84 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.003096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaea29a-e4ab-4186-a861-4a12a4ac32a1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.072243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:23.072864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.073166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.073439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.074124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:23.078315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:23.079749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:23.093995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 60/126] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:23.095190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.145532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5ad30-7c14-480b-a8dc-156897d1fd84 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.181108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:23.181108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.181108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.183237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.183951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:23.184312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:23.186479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:23.202486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 67/127] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:23.203353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.285864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:23.308947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5571e28-c6de-4068-b8d2-b40b1d2932ce None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.369489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:23.379787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:23.380468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.380755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.381030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.382053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:23.382572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:23.384436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:23.395288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 61/128] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:23.396604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.399969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4da9f5-f11c-46ff-ba51-c90a92dd4242 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.474518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7091-596f-42c0-a757-89dad450d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:23.475172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7091-596f-42c0-a757-89dad450d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.475459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7091-596f-42c0-a757-89dad450d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.475736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b7091-596f-42c0-a757-89dad450d3f2 None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.480744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7091-596f-42c0-a757-89dad450d3f2 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:23.482350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b7091-596f-42c0-a757-89dad450d3f2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:23.484244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 68/129] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:23 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:23.484927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7091-596f-42c0-a757-89dad450d3f2 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.523423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0848d1-a998-4d20-9ea5-66a201537416 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.597785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b7091-596f-42c0-a757-89dad450d3f2 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.606187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:23.609224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041e51b-7101-4ea2-8393-f823721b714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:23.609890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041e51b-7101-4ea2-8393-f823721b714a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.610181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041e51b-7101-4ea2-8393-f823721b714a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.610461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041e51b-7101-4ea2-8393-f823721b714a None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.611661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041e51b-7101-4ea2-8393-f823721b714a None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:23.617686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041e51b-7101-4ea2-8393-f823721b714a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:23.619733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 62/130] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:23 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:23.624851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041e51b-7101-4ea2-8393-f823721b714a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.658793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724d20b-6ee0-4c1b-a8f2-0804b9e20379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:23.661063 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724d20b-6ee0-4c1b-a8f2-0804b9e20379 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.661602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724d20b-6ee0-4c1b-a8f2-0804b9e20379 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.662072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724d20b-6ee0-4c1b-a8f2-0804b9e20379 None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.664755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724d20b-6ee0-4c1b-a8f2-0804b9e20379 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:23.667005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724d20b-6ee0-4c1b-a8f2-0804b9e20379 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:23.669517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 69/131] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:23 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:23.671769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724d20b-6ee0-4c1b-a8f2-0804b9e20379 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.751584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:23.807405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041e51b-7101-4ea2-8393-f823721b714a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.826587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724d20b-6ee0-4c1b-a8f2-0804b9e20379 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.846259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00037-9eda-4791-abf0-e7244abc67eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:23.847362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00037-9eda-4791-abf0-e7244abc67eb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.847999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00037-9eda-4791-abf0-e7244abc67eb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.848658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00037-9eda-4791-abf0-e7244abc67eb None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.850235 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00037-9eda-4791-abf0-e7244abc67eb None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:23.852129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00037-9eda-4791-abf0-e7244abc67eb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:23.859329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 63/132] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:23 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:23.860751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00037-9eda-4791-abf0-e7244abc67eb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.865898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798b963-a9ef-4478-b14f-523a061cc73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:23.866505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798b963-a9ef-4478-b14f-523a061cc73a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.866789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798b963-a9ef-4478-b14f-523a061cc73a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.867067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798b963-a9ef-4478-b14f-523a061cc73a None admin] PATH_INFO: `/v3/projects/7922e4410a1e4072ac0058c9c6dd6a3c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.868220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798b963-a9ef-4478-b14f-523a061cc73a None admin] RBAC: Authorizing `identity:get_project(project_id=7922e4410a1e4072ac0058c9c6dd6a3c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:23.869734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798b963-a9ef-4478-b14f-523a061cc73a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:23.871546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 70/133] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:23 2022] GET /identity/v3/projects/7922e4410a1e4072ac0058c9c6dd6a3c => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:23.872605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98266325-48fb-4333-9416-6d23f17a421b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:23.873378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98266325-48fb-4333-9416-6d23f17a421b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:23.873378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98266325-48fb-4333-9416-6d23f17a421b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:23.874478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 71/134] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:23.878521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98266325-48fb-4333-9416-6d23f17a421b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:23.925837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:23.981914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00037-9eda-4791-abf0-e7244abc67eb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:23.986802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98266325-48fb-4333-9416-6d23f17a421b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:24.007105 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:24.020559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82280-ec72-4774-8bc5-be73aaf43e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:24.021382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82280-ec72-4774-8bc5-be73aaf43e67 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.021864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82280-ec72-4774-8bc5-be73aaf43e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:24.022256 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82280-ec72-4774-8bc5-be73aaf43e67 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:24.023716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82280-ec72-4774-8bc5-be73aaf43e67 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:24.025407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976b8b4-a231-4988-98c0-56ad360c18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:24.025537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82280-ec72-4774-8bc5-be73aaf43e67 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:24.026325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976b8b4-a231-4988-98c0-56ad360c18ca None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.026764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976b8b4-a231-4988-98c0-56ad360c18ca None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:24.027177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976b8b4-a231-4988-98c0-56ad360c18ca None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685/users/6ec03fbc1019458b83bcc0af6fb04ad9/roles/3fa1cdc33cf343228f9d443a59102f22` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:24.028026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 64/135] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:23 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:24.029180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82280-ec72-4774-8bc5-be73aaf43e67 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:24.029953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976b8b4-a231-4988-98c0-56ad360c18ca None admin] RBAC: Authorizing `identity:create_grant(project_id=01eefcc996554d09bd94843c0e1e6685, user_id=6ec03fbc1019458b83bcc0af6fb04ad9, role_id=3fa1cdc33cf343228f9d443a59102f22)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:24.031550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976b8b4-a231-4988-98c0-56ad360c18ca None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:24.050173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 72/136] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:23 2022] PUT /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685/users/6ec03fbc1019458b83bcc0af6fb04ad9/roles/3fa1cdc33cf343228f9d443a59102f22 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:24.058123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c5851-d32e-4626-8491-ad7b871c4610 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.058785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c5851-d32e-4626-8491-ad7b871c4610 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:24.059198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c5851-d32e-4626-8491-ad7b871c4610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:24.094129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-da7c5851-d32e-4626-8491-ad7b871c4610 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:24.095658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-da7c5851-d32e-4626-8491-ad7b871c4610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:24.143389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82280-ec72-4774-8bc5-be73aaf43e67 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:24.182636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1eac-72fe-4a96-82e5-01676afc0b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:24.183446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1eac-72fe-4a96-82e5-01676afc0b77 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.184972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1eac-72fe-4a96-82e5-01676afc0b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:24.184972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1eac-72fe-4a96-82e5-01676afc0b77 None admin] PATH_INFO: `/v3/projects/7922e4410a1e4072ac0058c9c6dd6a3c/users/6ec03fbc1019458b83bcc0af6fb04ad9/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:24.186481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb1eac-72fe-4a96-82e5-01676afc0b77 None admin] RBAC: Authorizing `identity:create_grant(project_id=7922e4410a1e4072ac0058c9c6dd6a3c, user_id=6ec03fbc1019458b83bcc0af6fb04ad9, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:24.188068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb1eac-72fe-4a96-82e5-01676afc0b77 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:24.212953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 65/137] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:24 2022] PUT /identity/v3/projects/7922e4410a1e4072ac0058c9c6dd6a3c/users/6ec03fbc1019458b83bcc0af6fb04ad9/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:24.214775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1eac-72fe-4a96-82e5-01676afc0b77 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:24.258282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 73/138] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:24.306960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:24.363751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb1eac-72fe-4a96-82e5-01676afc0b77 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:24.401655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6a2f-11f7-40d9-ac13-0fc53cc43dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:24.402338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6a2f-11f7-40d9-ac13-0fc53cc43dac None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.402621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6a2f-11f7-40d9-ac13-0fc53cc43dac None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:24.402897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6a2f-11f7-40d9-ac13-0fc53cc43dac None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685/users/6ec03fbc1019458b83bcc0af6fb04ad9/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:24.405000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6a2f-11f7-40d9-ac13-0fc53cc43dac None admin] RBAC: Authorizing `identity:create_grant(project_id=01eefcc996554d09bd94843c0e1e6685, user_id=6ec03fbc1019458b83bcc0af6fb04ad9, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:24.406619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6a2f-11f7-40d9-ac13-0fc53cc43dac None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:24.425640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 66/139] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:24 2022] PUT /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685/users/6ec03fbc1019458b83bcc0af6fb04ad9/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:24.686553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c5851-d32e-4626-8491-ad7b871c4610 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:24.723244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:24.810646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c5851-d32e-4626-8491-ad7b871c4610 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:24.848124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3745-b1c6-4c56-9b34-4928bb46a797 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.848460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3745-b1c6-4c56-9b34-4928bb46a797 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:24.848697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb3745-b1c6-4c56-9b34-4928bb46a797 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:24.850311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 67/140] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:24.862412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfcfe2-e0ea-45cb-82d9-aa69a4a8ce2d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.862698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfcfe2-e0ea-45cb-82d9-aa69a4a8ce2d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:24.863038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfcfe2-e0ea-45cb-82d9-aa69a4a8ce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:24.882802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b90998-f70e-46ed-8245-17cc2da6c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:24.883391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b90998-f70e-46ed-8245-17cc2da6c4ba None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.883678 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b90998-f70e-46ed-8245-17cc2da6c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:24.883958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b90998-f70e-46ed-8245-17cc2da6c4ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:24.885114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b90998-f70e-46ed-8245-17cc2da6c4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:24.886576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b90998-f70e-46ed-8245-17cc2da6c4ba None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:24.893271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 74/141] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:24.894139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b90998-f70e-46ed-8245-17cc2da6c4ba None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:24.899150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6fbfcfe2-e0ea-45cb-82d9-aa69a4a8ce2d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:24.900489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6fbfcfe2-e0ea-45cb-82d9-aa69a4a8ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:24.998359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 68/142] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:24.999610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e7af4-a158-47de-939a-340ffad83bd3 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:24.999901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e7af4-a158-47de-939a-340ffad83bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:25.000177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e7af4-a158-47de-939a-340ffad83bd3 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:25.001491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 69/143] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:25.006763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4698-7b6a-40bc-897e-72d01a664029 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:25.007049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4698-7b6a-40bc-897e-72d01a664029 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:25.007327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4698-7b6a-40bc-897e-72d01a664029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:25.039736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-158e4698-7b6a-40bc-897e-72d01a664029 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:25.042281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-158e4698-7b6a-40bc-897e-72d01a664029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:25.083968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:25.089372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b90998-f70e-46ed-8245-17cc2da6c4ba None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:25.115366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:25.155313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d655-c655-426d-86df-baac0c996f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:25.155860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d655-c655-426d-86df-baac0c996f01 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:25.156140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d655-c655-426d-86df-baac0c996f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:25.156413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5d655-c655-426d-86df-baac0c996f01 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:25.157075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d655-c655-426d-86df-baac0c996f01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:25.161879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5d655-c655-426d-86df-baac0c996f01 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:25.178403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 70/144] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:25.196904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 75/145] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:05:24 2022] POST /identity/v3/users => generated 283 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:25.374127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e4698-7b6a-40bc-897e-72d01a664029 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:25.495279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e4698-7b6a-40bc-897e-72d01a664029 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:25.541533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12413c6e-fade-4d5d-b67b-50ed5167f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:25.542258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413c6e-fade-4d5d-b67b-50ed5167f34f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:25.542547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413c6e-fade-4d5d-b67b-50ed5167f34f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:25.542821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413c6e-fade-4d5d-b67b-50ed5167f34f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:25.573112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12413c6e-fade-4d5d-b67b-50ed5167f34f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-12413c6e-fade-4d5d-b67b-50ed5167f34f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:25.585134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:25.586025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:25.586887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 71/146] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:25.598690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d655-c655-426d-86df-baac0c996f01 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:25.650430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12413c6e-fade-4d5d-b67b-50ed5167f34f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:25.713226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:25.799260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5d655-c655-426d-86df-baac0c996f01 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:25.818204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12413c6e-fade-4d5d-b67b-50ed5167f34f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:25.861560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd22e1-ea31-4818-9007-4fcd901b3b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:25.862206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd22e1-ea31-4818-9007-4fcd901b3b42 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:25.863243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd22e1-ea31-4818-9007-4fcd901b3b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:25.863243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd22e1-ea31-4818-9007-4fcd901b3b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:25.881881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:25.885109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:25.885109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:25.885109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:25.885109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:25.885109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:25.885454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:25.900780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd22e1-ea31-4818-9007-4fcd901b3b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e7cd22e1-ea31-4818-9007-4fcd901b3b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:25.911525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:25.912429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:25.913667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:25.914276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 76/147] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:25.917691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 72/148] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:25.918913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:25.932399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd22e1-ea31-4818-9007-4fcd901b3b42 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:25.982413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:26.116112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:26.125709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd22e1-ea31-4818-9007-4fcd901b3b42 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:26.131756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950a1a6-68b7-49fa-902b-c57dc0635475 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:26.172273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7aed58-cba6-4990-ba33-378feb1621f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:26.173179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aed58-cba6-4990-ba33-378feb1621f7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:26.173734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aed58-cba6-4990-ba33-378feb1621f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:26.174243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7aed58-cba6-4990-ba33-378feb1621f7 None admin] PATH_INFO: `/v3/users/00095bd11d8244ebb8690f46d7ec553b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:26.175139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:26.175701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7aed58-cba6-4990-ba33-378feb1621f7 None admin] RBAC: Authorizing `identity:get_user(user_id=00095bd11d8244ebb8690f46d7ec553b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:26.175852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:26.176790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:26.177052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:26.178069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:26.178069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:26.179162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7aed58-cba6-4990-ba33-378feb1621f7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:26.179438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:26.181498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 77/149] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:25 2022] GET /identity/v3/users/00095bd11d8244ebb8690f46d7ec553b => generated 289 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:26.187264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7aed58-cba6-4990-ba33-378feb1621f7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:26.192976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 73/150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:26.198401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:26.283289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:26.305161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7aed58-cba6-4990-ba33-378feb1621f7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:26.324109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8aaac1-c371-469d-842a-4837450fab34 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:26.341934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a596b-920a-4ea6-8943-bd4b82787339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:26.342809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a596b-920a-4ea6-8943-bd4b82787339 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:26.343231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a596b-920a-4ea6-8943-bd4b82787339 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:26.343666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a596b-920a-4ea6-8943-bd4b82787339 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:26.344997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a596b-920a-4ea6-8943-bd4b82787339 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:26.346704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a596b-920a-4ea6-8943-bd4b82787339 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:26.353446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 78/151] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:26 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:26.355835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a596b-920a-4ea6-8943-bd4b82787339 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:26.390594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5d0d-3df8-4847-a8b1-b321159f2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:26.391210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5d0d-3df8-4847-a8b1-b321159f2b68 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:26.391434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5d0d-3df8-4847-a8b1-b321159f2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:26.391706 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f5d0d-3df8-4847-a8b1-b321159f2b68 None admin] PATH_INFO: `/v3/users/08b48eac02ed4bf2b170e97ff2aa351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:26.398010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5d0d-3df8-4847-a8b1-b321159f2b68 None admin] RBAC: Authorizing `identity:get_user(user_id=08b48eac02ed4bf2b170e97ff2aa351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:26.399525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f5d0d-3df8-4847-a8b1-b321159f2b68 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:26.401322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 74/152] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:26 2022] GET /identity/v3/users/08b48eac02ed4bf2b170e97ff2aa351b => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:26.407082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5d0d-3df8-4847-a8b1-b321159f2b68 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:26.471175 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:26.515273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a596b-920a-4ea6-8943-bd4b82787339 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:26.565492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c927-1785-45f8-bb81-230a2076c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:26.566177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c927-1785-45f8-bb81-230a2076c679 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:26.566501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c927-1785-45f8-bb81-230a2076c679 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:26.566795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c927-1785-45f8-bb81-230a2076c679 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685/users/00095bd11d8244ebb8690f46d7ec553b/roles/48a551b7e05445ceb37de851862f0cc8` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:26.568797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62c927-1785-45f8-bb81-230a2076c679 None admin] RBAC: Authorizing `identity:create_grant(project_id=01eefcc996554d09bd94843c0e1e6685, user_id=00095bd11d8244ebb8690f46d7ec553b, role_id=48a551b7e05445ceb37de851862f0cc8)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:26.570313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62c927-1785-45f8-bb81-230a2076c679 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:26.598287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 79/153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:26 2022] PUT /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685/users/00095bd11d8244ebb8690f46d7ec553b/roles/48a551b7e05445ceb37de851862f0cc8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:26.618105 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f5d0d-3df8-4847-a8b1-b321159f2b68 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:26.645197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c118-879e-4ac5-9a95-dd0532f12d27 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:26.645710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c118-879e-4ac5-9a95-dd0532f12d27 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:26.645710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c118-879e-4ac5-9a95-dd0532f12d27 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:26.647067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 80/154] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:26.652765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c5e7-14f2-4c64-b830-26af6e42082d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:26.653061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c5e7-14f2-4c64-b830-26af6e42082d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:26.653346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c5e7-14f2-4c64-b830-26af6e42082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:26.670401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64f6c-0a82-49de-93a8-19e56990ce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:26.671040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64f6c-0a82-49de-93a8-19e56990ce0a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:26.671314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64f6c-0a82-49de-93a8-19e56990ce0a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:26.671579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc64f6c-0a82-49de-93a8-19e56990ce0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:26.676620 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-3790c5e7-14f2-4c64-b830-26af6e42082d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:26.678091 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3790c5e7-14f2-4c64-b830-26af6e42082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:26.689658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:26.763411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 81/155] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:26.817683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc64f6c-0a82-49de-93a8-19e56990ce0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:26.819187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc64f6c-0a82-49de-93a8-19e56990ce0a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:26.849527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:26.932394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 75/156] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 05:05:26.937829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c5e7-14f2-4c64-b830-26af6e42082d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:27.070022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c5e7-14f2-4c64-b830-26af6e42082d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:27.107249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25817d-7c04-4850-ba87-f4667879b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:27.108259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25817d-7c04-4850-ba87-f4667879b432 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:27.108747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25817d-7c04-4850-ba87-f4667879b432 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:27.109235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25817d-7c04-4850-ba87-f4667879b432 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:27.110548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25817d-7c04-4850-ba87-f4667879b432 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:27.112182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25817d-7c04-4850-ba87-f4667879b432 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:27.114121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 82/157] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:26 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:27.120044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64f6c-0a82-49de-93a8-19e56990ce0a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:27.272416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc64f6c-0a82-49de-93a8-19e56990ce0a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:27.295995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:27.313441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:27.314065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:27.314344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:27.314616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:27.315359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=01eefcc996554d09bd94843c0e1e6685, user.id=08b48eac02ed4bf2b170e97ff2aa351b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:27.315666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:27.317346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:27.323589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 76/158] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:27 2022] GET /identity/v3/role_assignments?user.id=08b48eac02ed4bf2b170e97ff2aa351b&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=6da07502c09e4fc8afb31b58e434479b => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:27.324088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25817d-7c04-4850-ba87-f4667879b432 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:27.353114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:27.460204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25817d-7c04-4850-ba87-f4667879b432 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:27.496847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879434e-9618-4872-bdcd-a12e9c8db236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:27.497964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879434e-9618-4872-bdcd-a12e9c8db236 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:27.498513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879434e-9618-4872-bdcd-a12e9c8db236 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:27.499009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879434e-9618-4872-bdcd-a12e9c8db236 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:27.510709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879434e-9618-4872-bdcd-a12e9c8db236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-0879434e-9618-4872-bdcd-a12e9c8db236 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:27.516246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:27.517136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:27.517966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:27.520894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 83/159] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:27.526569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:27.652510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1390-03b0-4ba1-a14b-306744303262 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:27.693838 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724e9fb-d530-4975-bb4d-80b3824647fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:27.694472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724e9fb-d530-4975-bb4d-80b3824647fc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:27.694761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724e9fb-d530-4975-bb4d-80b3824647fc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:27.695012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724e9fb-d530-4975-bb4d-80b3824647fc None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:27.695694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724e9fb-d530-4975-bb4d-80b3824647fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:27.695991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724e9fb-d530-4975-bb4d-80b3824647fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:27.697439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724e9fb-d530-4975-bb4d-80b3824647fc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:27.706524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 77/160] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:27.712543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879434e-9618-4872-bdcd-a12e9c8db236 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:27.813835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:27.820265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20154-7e6d-407b-9a8e-cd1863a4ab36 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:27.820554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20154-7e6d-407b-9a8e-cd1863a4ab36 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:27.820814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20154-7e6d-407b-9a8e-cd1863a4ab36 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:27.822315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 78/161] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:27.835495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4f4d9-1b08-4c55-b1f7-41f092d08814 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:27.835801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4f4d9-1b08-4c55-b1f7-41f092d08814 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:27.836040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4f4d9-1b08-4c55-b1f7-41f092d08814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:27.847294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879434e-9618-4872-bdcd-a12e9c8db236 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:27.882169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-06f4f4d9-1b08-4c55-b1f7-41f092d08814 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:27.883399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-06f4f4d9-1b08-4c55-b1f7-41f092d08814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:27.884070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e571-ed31-4417-afa5-05d44d35d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:27.884787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e571-ed31-4417-afa5-05d44d35d75d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:27.885158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e571-ed31-4417-afa5-05d44d35d75d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:27.885682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3e571-ed31-4417-afa5-05d44d35d75d None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:27.886910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3e571-ed31-4417-afa5-05d44d35d75d None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:27.889711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3e571-ed31-4417-afa5-05d44d35d75d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:27.891788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 84/162] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:27 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:27.897839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e571-ed31-4417-afa5-05d44d35d75d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:28.035322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3e571-ed31-4417-afa5-05d44d35d75d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:28.036006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:28.081763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53bf0-6942-4a10-8623-f0c0c4d305c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:28.082699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53bf0-6942-4a10-8623-f0c0c4d305c7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:28.083014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53bf0-6942-4a10-8623-f0c0c4d305c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:28.083287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53bf0-6942-4a10-8623-f0c0c4d305c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:28.098400 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:28.126527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 79/163] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:28.164796 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f784-8ea3-46ae-ab37-7c7c5ad71762 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:28.165147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f784-8ea3-46ae-ab37-7c7c5ad71762 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:28.165368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7f784-8ea3-46ae-ab37-7c7c5ad71762 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:28.166968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 80/164] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:28.175546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb53bf0-6942-4a10-8623-f0c0c4d305c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:28.177272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb53bf0-6942-4a10-8623-f0c0c4d305c7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:28.179369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dacb2-0950-49d1-9f34-1b30664b9200 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:28.179649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dacb2-0950-49d1-9f34-1b30664b9200 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:28.179921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dacb2-0950-49d1-9f34-1b30664b9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:28.227512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7b3dacb2-0950-49d1-9f34-1b30664b9200 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:28.228774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7b3dacb2-0950-49d1-9f34-1b30664b9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:28.287581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 85/165] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:28.293557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53bf0-6942-4a10-8623-f0c0c4d305c7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:28.357587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:28.429747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53bf0-6942-4a10-8623-f0c0c4d305c7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:28.483268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cbb5a-d329-4b74-b230-a1822a15d6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:28.483971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cbb5a-d329-4b74-b230-a1822a15d6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:28.484252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cbb5a-d329-4b74-b230-a1822a15d6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:28.484528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cbb5a-d329-4b74-b230-a1822a15d6d3 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:28.485830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cbb5a-d329-4b74-b230-a1822a15d6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:28.486057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 81/166] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:28.487415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cbb5a-d329-4b74-b230-a1822a15d6d3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:28.489167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 86/167] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:28 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:28.495456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dacb2-0950-49d1-9f34-1b30664b9200 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:28.560392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cbb5a-d329-4b74-b230-a1822a15d6d3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:28.698832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dacb2-0950-49d1-9f34-1b30664b9200 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:28.703768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cbb5a-d329-4b74-b230-a1822a15d6d3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:28.721457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:28.730677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:28.782354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:28.782969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:28.783243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:28.783510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:28.784248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] RBAC: Adding query filter params (role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=01eefcc996554d09bd94843c0e1e6685, user.id=6ec03fbc1019458b83bcc0af6fb04ad9) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:28.784567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:28.786179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:28.796189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21bc3c-fe40-4984-9167-eedcbec28997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:28.796838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21bc3c-fe40-4984-9167-eedcbec28997 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:28.797123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21bc3c-fe40-4984-9167-eedcbec28997 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:28.797396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21bc3c-fe40-4984-9167-eedcbec28997 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:28.809052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 82/168] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:28 2022] GET /identity/v3/role_assignments?user.id=6ec03fbc1019458b83bcc0af6fb04ad9&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:28.819256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21bc3c-fe40-4984-9167-eedcbec28997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-2f21bc3c-fe40-4984-9167-eedcbec28997 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:28.824190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:28.825159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:28.826056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 87/169] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:28.831095 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:28.969523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76935be0-72cb-42ea-a2e4-409e727be647 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:29.022491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189703e-65d9-4679-b287-e9219488048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:29.023130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189703e-65d9-4679-b287-e9219488048f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:29.023412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189703e-65d9-4679-b287-e9219488048f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:29.023687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189703e-65d9-4679-b287-e9219488048f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:29.024382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189703e-65d9-4679-b287-e9219488048f None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:29.024689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189703e-65d9-4679-b287-e9219488048f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:29.026129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189703e-65d9-4679-b287-e9219488048f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:29.041031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 83/170] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:29.046801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21bc3c-fe40-4984-9167-eedcbec28997 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:29.057527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189703e-65d9-4679-b287-e9219488048f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:29.113017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:29.234582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189703e-65d9-4679-b287-e9219488048f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:29.257593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21bc3c-fe40-4984-9167-eedcbec28997 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:29.310625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b24a6a-45e1-48a9-b5d0-54a55d05af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:29.311647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24a6a-45e1-48a9-b5d0-54a55d05af59 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:29.312217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24a6a-45e1-48a9-b5d0-54a55d05af59 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:29.313466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b24a6a-45e1-48a9-b5d0-54a55d05af59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:29.335456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd7620-d777-4408-8de3-bd4603099d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:29.336487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7620-d777-4408-8de3-bd4603099d18 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:29.336971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7620-d777-4408-8de3-bd4603099d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:29.337713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd7620-d777-4408-8de3-bd4603099d18 None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:29.338444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b24a6a-45e1-48a9-b5d0-54a55d05af59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-96b24a6a-45e1-48a9-b5d0-54a55d05af59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:29.344562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:29.347133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:29.348089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:29.349944 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd7620-d777-4408-8de3-bd4603099d18 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:29.351779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd7620-d777-4408-8de3-bd4603099d18 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:29.353701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 88/171] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:29 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:29.355127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 84/172] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:29.359447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd7620-d777-4408-8de3-bd4603099d18 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:29.360966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b24a6a-45e1-48a9-b5d0-54a55d05af59 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:29.443815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:29.590578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:29.597467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd7620-d777-4408-8de3-bd4603099d18 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:29.599231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b24a6a-45e1-48a9-b5d0-54a55d05af59 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:29.659342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:29.660021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:29.660513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:29.660608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:29.661329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:29.661636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:29.663787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:29.679947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 85/173] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:29.685650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:29.688857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beddc9-eaf5-40af-8ce0-27b1967435cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:29.689529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beddc9-eaf5-40af-8ce0-27b1967435cc None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:29.689821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beddc9-eaf5-40af-8ce0-27b1967435cc None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:29.690081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beddc9-eaf5-40af-8ce0-27b1967435cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:29.806182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310f29b-3230-4db0-8b51-51e24f7ddc51 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:29.854538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beddc9-eaf5-40af-8ce0-27b1967435cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:29.855939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beddc9-eaf5-40af-8ce0-27b1967435cc None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:29.860759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d436349-060a-4d74-a71f-5213f73b4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:29.861439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d436349-060a-4d74-a71f-5213f73b4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:29.861722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d436349-060a-4d74-a71f-5213f73b4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:29.861999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d436349-060a-4d74-a71f-5213f73b4aa0 None admin] PATH_INFO: `/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:29.864874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d436349-060a-4d74-a71f-5213f73b4aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec03fbc1019458b83bcc0af6fb04ad9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:29.866366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d436349-060a-4d74-a71f-5213f73b4aa0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:29.868003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 86/174] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:29 2022] GET /identity/v3/users/6ec03fbc1019458b83bcc0af6fb04ad9 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:29.869188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4fef4-464d-4fcf-97e5-c4ed5a0fb41d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:29.869471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4fef4-464d-4fcf-97e5-c4ed5a0fb41d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:29.869741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4fef4-464d-4fcf-97e5-c4ed5a0fb41d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:29.871084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 87/175] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:29.873999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4fef4-464d-4fcf-97e5-c4ed5a0fb41d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:29.915714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:29.928788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:30.029003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 89/176] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:30.030774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027897e-c0c7-433c-b474-9a64d9ac5c4a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.031251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027897e-c0c7-433c-b474-9a64d9ac5c4a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.031785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027897e-c0c7-433c-b474-9a64d9ac5c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.051473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-5027897e-c0c7-433c-b474-9a64d9ac5c4a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:30.052469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4fef4-464d-4fcf-97e5-c4ed5a0fb41d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:30.053366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5027897e-c0c7-433c-b474-9a64d9ac5c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:30.096560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3168cb-39c4-4189-b3e9-90b496adf0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:30.097559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3168cb-39c4-4189-b3e9-90b496adf0af None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.097940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3168cb-39c4-4189-b3e9-90b496adf0af None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.098369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3168cb-39c4-4189-b3e9-90b496adf0af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.124498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 90/177] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:30.125631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5a72-7f7b-4c9e-9b89-25d1cf8c353e None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.126214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5a72-7f7b-4c9e-9b89-25d1cf8c353e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.126491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa5a72-7f7b-4c9e-9b89-25d1cf8c353e None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.127787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 91/178] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:30.128736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa5a72-7f7b-4c9e-9b89-25d1cf8c353e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:30.172517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3168cb-39c4-4189-b3e9-90b496adf0af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:30.174419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3168cb-39c4-4189-b3e9-90b496adf0af None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:30.205964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:30.213251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:30.254691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa5a72-7f7b-4c9e-9b89-25d1cf8c353e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:30.302355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619e6d-92f9-4f88-97c6-55bca587da1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:30.303402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619e6d-92f9-4f88-97c6-55bca587da1f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.303898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619e6d-92f9-4f88-97c6-55bca587da1f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.304377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619e6d-92f9-4f88-97c6-55bca587da1f None admin] PATH_INFO: `/v3/projects/7922e4410a1e4072ac0058c9c6dd6a3c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.305999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19619e6d-92f9-4f88-97c6-55bca587da1f None admin] RBAC: Authorizing `identity:get_project(project_id=7922e4410a1e4072ac0058c9c6dd6a3c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:30.308653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19619e6d-92f9-4f88-97c6-55bca587da1f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:30.309887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 88/179] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:30.310865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 92/180] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:30 2022] GET /identity/v3/projects/7922e4410a1e4072ac0058c9c6dd6a3c => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:30.311603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8a0e7-2d13-41c9-9b9d-0251a5ef262b None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.312035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8a0e7-2d13-41c9-9b9d-0251a5ef262b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.312388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e217e1-d7c2-4055-b9ef-45851e10dce4 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.312603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8a0e7-2d13-41c9-9b9d-0251a5ef262b None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.312884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e217e1-d7c2-4055-b9ef-45851e10dce4 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.313285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e217e1-d7c2-4055-b9ef-45851e10dce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.314309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 89/181] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:30.324174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8a0e7-2d13-41c9-9b9d-0251a5ef262b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:30.333610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-05e217e1-d7c2-4055-b9ef-45851e10dce4 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:30.335125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-05e217e1-d7c2-4055-b9ef-45851e10dce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:30.403552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 93/182] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:30.404805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7f727-eb03-43c5-bba2-b94e5b8c9ea9 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.405110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7f727-eb03-43c5-bba2-b94e5b8c9ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.405395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7f727-eb03-43c5-bba2-b94e5b8c9ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.422725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b9c7f727-eb03-43c5-bba2-b94e5b8c9ea9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:30.423914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b9c7f727-eb03-43c5-bba2-b94e5b8c9ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:30.429590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8a0e7-2d13-41c9-9b9d-0251a5ef262b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:30.455291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:30.467153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:30.467770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.468055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.468321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.469253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] RBAC: Adding query filter params (role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=7922e4410a1e4072ac0058c9c6dd6a3c, user.id=6ec03fbc1019458b83bcc0af6fb04ad9) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:30.469566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:30.471007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:30.489208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 90/183] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:30 2022] GET /identity/v3/role_assignments?user.id=6ec03fbc1019458b83bcc0af6fb04ad9&scope.project.id=7922e4410a1e4072ac0058c9c6dd6a3c&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:30.489208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:30.504513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:30.521146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 94/184] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:30.522968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4001-e0dc-4a85-87c3-cd5f4a12e652 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.523404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4001-e0dc-4a85-87c3-cd5f4a12e652 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.523818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4001-e0dc-4a85-87c3-cd5f4a12e652 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.526325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 95/185] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:30.527787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4001-e0dc-4a85-87c3-cd5f4a12e652 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:30.603552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2069fe7-6ccb-47ed-88f6-c6d8cde77fb3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:30.682069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39db76f-2ba6-4557-8682-24e73b161726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:30.682633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db76f-2ba6-4557-8682-24e73b161726 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.682911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db76f-2ba6-4557-8682-24e73b161726 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.683183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39db76f-2ba6-4557-8682-24e73b161726 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.684312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39db76f-2ba6-4557-8682-24e73b161726 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:30.685808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39db76f-2ba6-4557-8682-24e73b161726 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:30.687530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 91/186] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:30 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:30.688561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270c9fe-8588-498b-9594-57f128e275c1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.688840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270c9fe-8588-498b-9594-57f128e275c1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.694494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270c9fe-8588-498b-9594-57f128e275c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.713837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4001-e0dc-4a85-87c3-cd5f4a12e652 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:30.715769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4270c9fe-8588-498b-9594-57f128e275c1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:30.717876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4270c9fe-8588-498b-9594-57f128e275c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:30.763975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa67a3-186d-4e7d-b597-643c013d0509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:30.764622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa67a3-186d-4e7d-b597-643c013d0509 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.764897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa67a3-186d-4e7d-b597-643c013d0509 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.765209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa67a3-186d-4e7d-b597-643c013d0509 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.774470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:30.778342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa67a3-186d-4e7d-b597-643c013d0509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-6ffa67a3-186d-4e7d-b597-643c013d0509 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:30.783453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:30.784361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:30.785429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 96/187] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:30.786461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa67a3-186d-4e7d-b597-643c013d0509 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:30.801875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 92/188] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:30.809959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270c9fe-8588-498b-9594-57f128e275c1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:30.846446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:30.892125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa67a3-186d-4e7d-b597-643c013d0509 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:30.929481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb236c2-dfb8-409b-8d69-2b67bd6deecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:30.930355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb236c2-dfb8-409b-8d69-2b67bd6deecc None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.930818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb236c2-dfb8-409b-8d69-2b67bd6deecc None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.931239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb236c2-dfb8-409b-8d69-2b67bd6deecc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.932565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb236c2-dfb8-409b-8d69-2b67bd6deecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:30.934176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb236c2-dfb8-409b-8d69-2b67bd6deecc None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:30.935904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 97/189] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:30.936845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb236c2-dfb8-409b-8d69-2b67bd6deecc None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:30.941304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270c9fe-8588-498b-9594-57f128e275c1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:30.977995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:30.978616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:30.978897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:30.979168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:30.979901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] RBAC: Adding query filter params (role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=01eefcc996554d09bd94843c0e1e6685, user.id=6ec03fbc1019458b83bcc0af6fb04ad9) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:30.980209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:30.981726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:30.987753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 93/190] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:30 2022] GET /identity/v3/role_assignments?user.id=6ec03fbc1019458b83bcc0af6fb04ad9&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:30.998165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.059887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb236c2-dfb8-409b-8d69-2b67bd6deecc None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.075407 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:31.088960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:31.102456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.103089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.103363 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.103631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.104320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:31.104611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:31.106035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:31.120230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 98/191] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:31.120230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.136868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6f08a-80f4-45c0-b28b-bf6ff32cfb07 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.176625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e27273-b1a0-42aa-9a63-44006859acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.177506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e27273-b1a0-42aa-9a63-44006859acd3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.177814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e27273-b1a0-42aa-9a63-44006859acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.178087 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e27273-b1a0-42aa-9a63-44006859acd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.189368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e27273-b1a0-42aa-9a63-44006859acd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d2e27273-b1a0-42aa-9a63-44006859acd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:31.194624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:31.195773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 94/192] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:31.196599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e27273-b1a0-42aa-9a63-44006859acd3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.253110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd4f24-bf61-4cbc-baf7-72cc3df1785e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.286347 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9037b65-1423-4ff6-83de-00344a4e8caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.286959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9037b65-1423-4ff6-83de-00344a4e8caa None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.287235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9037b65-1423-4ff6-83de-00344a4e8caa None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.287503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9037b65-1423-4ff6-83de-00344a4e8caa None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.288161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9037b65-1423-4ff6-83de-00344a4e8caa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:31.289645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9037b65-1423-4ff6-83de-00344a4e8caa None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:31.305123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e27273-b1a0-42aa-9a63-44006859acd3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.310777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 99/193] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:05:31 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:31.315692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:31.318524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9037b65-1423-4ff6-83de-00344a4e8caa None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.346497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d741f-2afc-4d40-a690-61aa8d17f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.347459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d741f-2afc-4d40-a690-61aa8d17f015 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.347774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d741f-2afc-4d40-a690-61aa8d17f015 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.348058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d741f-2afc-4d40-a690-61aa8d17f015 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.362468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d741f-2afc-4d40-a690-61aa8d17f015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ee7d741f-2afc-4d40-a690-61aa8d17f015 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:31.367585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:31.368614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:31.369470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:31.372476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:31.374229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 95/194] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:31.374811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d741f-2afc-4d40-a690-61aa8d17f015 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.442336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9037b65-1423-4ff6-83de-00344a4e8caa None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.484245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae2d3a-e1d1-484c-8b39-722f988756d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.485038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2d3a-e1d1-484c-8b39-722f988756d7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.485374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2d3a-e1d1-484c-8b39-722f988756d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.485639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2d3a-e1d1-484c-8b39-722f988756d7 None admin] PATH_INFO: `/v3/users/de189192f50b4598a9e15d80565c241c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.486565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d741f-2afc-4d40-a690-61aa8d17f015 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.500256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae2d3a-e1d1-484c-8b39-722f988756d7 None admin] RBAC: Authorizing `identity:get_user(user_id=de189192f50b4598a9e15d80565c241c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:31.501858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae2d3a-e1d1-484c-8b39-722f988756d7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:31.503559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 100/195] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:31 2022] GET /identity/v3/users/de189192f50b4598a9e15d80565c241c => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:31.509853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae2d3a-e1d1-484c-8b39-722f988756d7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.530639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.531600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.532070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.532530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.533615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:31.534101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:31.538162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:31.552050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 96/196] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:31.553546 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.615057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:31.639448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:31.643935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae2d3a-e1d1-484c-8b39-722f988756d7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.689840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.690459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.690757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.691024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.691867 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:31.692121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:31.694339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:31.707193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 101/197] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:31.708046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.709299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e15e3-a6d7-478b-9f6f-265e45b3e729 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.756233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769a9fa-bf46-479a-ae8b-e081565dd25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.757194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769a9fa-bf46-479a-ae8b-e081565dd25b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.758163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769a9fa-bf46-479a-ae8b-e081565dd25b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.758880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769a9fa-bf46-479a-ae8b-e081565dd25b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.826284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f122-f591-4207-af01-178b5716d6f8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:31.838027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769a9fa-bf46-479a-ae8b-e081565dd25b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:31.839586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769a9fa-bf46-479a-ae8b-e081565dd25b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:31.865077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268460-cadd-4338-9eaa-9d5a4a207fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:31.866162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268460-cadd-4338-9eaa-9d5a4a207fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:31.866715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268460-cadd-4338-9eaa-9d5a4a207fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:31.867185 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268460-cadd-4338-9eaa-9d5a4a207fc7 None admin] PATH_INFO: `/v3/users/de189192f50b4598a9e15d80565c241c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:31.868516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1268460-cadd-4338-9eaa-9d5a4a207fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=de189192f50b4598a9e15d80565c241c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:31.869689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:31.871432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1268460-cadd-4338-9eaa-9d5a4a207fc7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:31.873425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 102/198] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:31 2022] GET /identity/v3/users/de189192f50b4598a9e15d80565c241c => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:31.874715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268460-cadd-4338-9eaa-9d5a4a207fc7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.907594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:31.940765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 97/199] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:31.946093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769a9fa-bf46-479a-ae8b-e081565dd25b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:31.990651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268460-cadd-4338-9eaa-9d5a4a207fc7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:32.030162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850e105-92cf-4357-8949-11a0db57c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:32.031236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850e105-92cf-4357-8949-11a0db57c41d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:32.031817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850e105-92cf-4357-8949-11a0db57c41d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:32.032261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850e105-92cf-4357-8949-11a0db57c41d None admin] PATH_INFO: `/v3/users/00095bd11d8244ebb8690f46d7ec553b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:32.033645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850e105-92cf-4357-8949-11a0db57c41d None admin] RBAC: Authorizing `identity:get_user(user_id=00095bd11d8244ebb8690f46d7ec553b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:32.035415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850e105-92cf-4357-8949-11a0db57c41d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:32.037572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 103/200] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:31 2022] GET /identity/v3/users/00095bd11d8244ebb8690f46d7ec553b => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:32.038678 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850e105-92cf-4357-8949-11a0db57c41d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:32.047086 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769a9fa-bf46-479a-ae8b-e081565dd25b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:32.076645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:32.083339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b12311-da4d-4151-a596-8839e2cbdf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:32.083964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12311-da4d-4151-a596-8839e2cbdf61 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:32.084239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12311-da4d-4151-a596-8839e2cbdf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:32.084507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12311-da4d-4151-a596-8839e2cbdf61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:32.148372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:32.155300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b12311-da4d-4151-a596-8839e2cbdf61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:32.155763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850e105-92cf-4357-8949-11a0db57c41d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:32.156818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b12311-da4d-4151-a596-8839e2cbdf61 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:32.193638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571b58-49ba-4ecc-b0ab-4553f954fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:32.194671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571b58-49ba-4ecc-b0ab-4553f954fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:32.195150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571b58-49ba-4ecc-b0ab-4553f954fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:32.195651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571b58-49ba-4ecc-b0ab-4553f954fdd6 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:32.197172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571b58-49ba-4ecc-b0ab-4553f954fdd6 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:32.198943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01571b58-49ba-4ecc-b0ab-4553f954fdd6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:32.200900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 104/201] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:32 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:32.201905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571b58-49ba-4ecc-b0ab-4553f954fdd6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:32.261409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 98/202] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:32.262360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b12311-da4d-4151-a596-8839e2cbdf61 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:32.292570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:32.316625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571b58-49ba-4ecc-b0ab-4553f954fdd6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:32.355732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5c3b9-4e69-4477-b630-d5b0d9ac4e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:32.356691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c3b9-4e69-4477-b630-d5b0d9ac4e38 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:32.357229 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c3b9-4e69-4477-b630-d5b0d9ac4e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:32.357791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5c3b9-4e69-4477-b630-d5b0d9ac4e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:32.361226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b12311-da4d-4151-a596-8839e2cbdf61 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:32.392192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:32.396148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:32.396858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:32.397045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:32.397328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:32.398394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=1be4be6e21b140929ca372bd03dc82ab, user.id=de189192f50b4598a9e15d80565c241c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:32.398713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:32.400261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:32.405979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 99/203] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:32 2022] GET /identity/v3/role_assignments?user.id=de189192f50b4598a9e15d80565c241c&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=6da07502c09e4fc8afb31b58e434479b => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:32.406760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:32.437938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5c3b9-4e69-4477-b630-d5b0d9ac4e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:32.439952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5c3b9-4e69-4477-b630-d5b0d9ac4e38 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:32.554405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 105/204] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:32.563497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:32.563802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5c3b9-4e69-4477-b630-d5b0d9ac4e38 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:32.573904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439a1f-f575-4da1-b6df-d0155b12a325 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:32.640668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dfe16-23bc-4e87-a766-235ff8f62a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:32.641382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dfe16-23bc-4e87-a766-235ff8f62a59 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:32.641631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dfe16-23bc-4e87-a766-235ff8f62a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:32.641865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dfe16-23bc-4e87-a766-235ff8f62a59 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:32.643422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dfe16-23bc-4e87-a766-235ff8f62a59 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:32.645261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dfe16-23bc-4e87-a766-235ff8f62a59 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:32.646994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 100/205] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:32 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:32.653055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dfe16-23bc-4e87-a766-235ff8f62a59 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:32.688719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:32.732434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5c3b9-4e69-4477-b630-d5b0d9ac4e38 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:32.770532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593843-0dd9-458b-abb8-67189a8d4e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:32.771578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593843-0dd9-458b-abb8-67189a8d4e0a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:32.771865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593843-0dd9-458b-abb8-67189a8d4e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:32.772139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593843-0dd9-458b-abb8-67189a8d4e0a None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:32.773498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593843-0dd9-458b-abb8-67189a8d4e0a None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:32.775368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593843-0dd9-458b-abb8-67189a8d4e0a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:32.777321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 106/206] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:32 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:32.787556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593843-0dd9-458b-abb8-67189a8d4e0a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:32.844663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dfe16-23bc-4e87-a766-235ff8f62a59 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:32.905551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29292d55-6e5f-4696-b207-27438a992298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:32.906171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292d55-6e5f-4696-b207-27438a992298 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:32.906454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292d55-6e5f-4696-b207-27438a992298 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:32.906725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29292d55-6e5f-4696-b207-27438a992298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:32.907459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29292d55-6e5f-4696-b207-27438a992298 None admin] RBAC: Adding query filter params (role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=1be4be6e21b140929ca372bd03dc82ab, user.id=de189192f50b4598a9e15d80565c241c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:32.907767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29292d55-6e5f-4696-b207-27438a992298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:32.909242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29292d55-6e5f-4696-b207-27438a992298 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:32.929229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 101/207] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:32 2022] GET /identity/v3/role_assignments?user.id=de189192f50b4598a9e15d80565c241c&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:32.953047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593843-0dd9-458b-abb8-67189a8d4e0a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:33.001794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:33.008334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5eff8-0d0f-4730-8a28-cf18e8f7545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:33.009648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5eff8-0d0f-4730-8a28-cf18e8f7545a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:33.010160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5eff8-0d0f-4730-8a28-cf18e8f7545a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:33.010637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5eff8-0d0f-4730-8a28-cf18e8f7545a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:33.011596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5eff8-0d0f-4730-8a28-cf18e8f7545a None admin] RBAC: Adding query filter params (role.id=48a551b7e05445ceb37de851862f0cc8, scope.project.id=01eefcc996554d09bd94843c0e1e6685, user.id=00095bd11d8244ebb8690f46d7ec553b) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:33.012118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5eff8-0d0f-4730-8a28-cf18e8f7545a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:33.014123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5eff8-0d0f-4730-8a28-cf18e8f7545a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:33.021758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 107/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:32 2022] GET /identity/v3/role_assignments?user.id=00095bd11d8244ebb8690f46d7ec553b&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=48a551b7e05445ceb37de851862f0cc8 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:33.567209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3994f90-42fe-4a99-a903-5e4117bea7f8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:33.567605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3994f90-42fe-4a99-a903-5e4117bea7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:33.567785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3994f90-42fe-4a99-a903-5e4117bea7f8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:33.569206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 102/209] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:33.579113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b7675-515b-4457-8d93-d57baa8e310b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:33.579407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b7675-515b-4457-8d93-d57baa8e310b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:33.579672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b7675-515b-4457-8d93-d57baa8e310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:33.600630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f84b7675-515b-4457-8d93-d57baa8e310b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:33.601897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f84b7675-515b-4457-8d93-d57baa8e310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:33.636307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160f72b-d5e0-4c04-9633-2cbc2c81bb9e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:33.636867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160f72b-d5e0-4c04-9633-2cbc2c81bb9e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:33.637562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160f72b-d5e0-4c04-9633-2cbc2c81bb9e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:33.640293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 103/210] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:33.645115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff2fe4-632b-411b-b520-085b5e17a6e7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:33.645834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff2fe4-632b-411b-b520-085b5e17a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:33.645834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff2fe4-632b-411b-b520-085b5e17a6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:33.673115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b3ff2fe4-632b-411b-b520-085b5e17a6e7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:33.673115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b3ff2fe4-632b-411b-b520-085b5e17a6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:33.688022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 108/211] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:33.697732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:33.743093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 104/212] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:33.966647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b7675-515b-4457-8d93-d57baa8e310b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:34.017443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff2fe4-632b-411b-b520-085b5e17a6e7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:34.081730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b7675-515b-4457-8d93-d57baa8e310b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:34.109300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:34.120077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60f1c-f3af-4eb1-8ff2-7d0a92d2511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:34.120730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60f1c-f3af-4eb1-8ff2-7d0a92d2511e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:34.121070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60f1c-f3af-4eb1-8ff2-7d0a92d2511e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:34.121374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d60f1c-f3af-4eb1-8ff2-7d0a92d2511e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:34.135244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff2fe4-632b-411b-b520-085b5e17a6e7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:34.135710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d60f1c-f3af-4eb1-8ff2-7d0a92d2511e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-30d60f1c-f3af-4eb1-8ff2-7d0a92d2511e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:34.141245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:34.142169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:34.142972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 109/213] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:34.149384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60f1c-f3af-4eb1-8ff2-7d0a92d2511e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:34.183232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9bdbc-4a89-4d3a-984c-5c0d5cad7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:34.184219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bdbc-4a89-4d3a-984c-5c0d5cad7b4f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:34.184716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bdbc-4a89-4d3a-984c-5c0d5cad7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:34.185348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9bdbc-4a89-4d3a-984c-5c0d5cad7b4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:34.187459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9bdbc-4a89-4d3a-984c-5c0d5cad7b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:34.189117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9bdbc-4a89-4d3a-984c-5c0d5cad7b4f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:34.191413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 105/214] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:34.198381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9bdbc-4a89-4d3a-984c-5c0d5cad7b4f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:34.234778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:34.261998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d60f1c-f3af-4eb1-8ff2-7d0a92d2511e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:34.298120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:34.298796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:34.299079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:34.299351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:34.300023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:34.300326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:34.301814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:34.315366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 110/215] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:34.316442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:34.342626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9bdbc-4a89-4d3a-984c-5c0d5cad7b4f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:34.369139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:34.391019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3627a2-3367-4191-9b65-e7b3ae7a58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:34.392152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3627a2-3367-4191-9b65-e7b3ae7a58bf None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:34.392649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3627a2-3367-4191-9b65-e7b3ae7a58bf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:34.393321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3627a2-3367-4191-9b65-e7b3ae7a58bf None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:34.395172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3627a2-3367-4191-9b65-e7b3ae7a58bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:34.396815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3627a2-3367-4191-9b65-e7b3ae7a58bf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:34.426023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 106/216] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:05:34 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:05:34.432148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef234-be37-47cd-9bfb-478865c49dee None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:34.472250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87378bc0-38be-4528-b5ee-1297b34500ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:34.473427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87378bc0-38be-4528-b5ee-1297b34500ab None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:34.473879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87378bc0-38be-4528-b5ee-1297b34500ab None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:34.474356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87378bc0-38be-4528-b5ee-1297b34500ab None admin] PATH_INFO: `/v3/users/17cd928b6f814c88957c4213a3acfb27` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:34.490857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87378bc0-38be-4528-b5ee-1297b34500ab None admin] RBAC: Authorizing `identity:get_user(user_id=17cd928b6f814c88957c4213a3acfb27)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:34.492621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87378bc0-38be-4528-b5ee-1297b34500ab None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:34.495012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 111/217] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:34 2022] GET /identity/v3/users/17cd928b6f814c88957c4213a3acfb27 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:34.501177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3627a2-3367-4191-9b65-e7b3ae7a58bf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:34.529965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5789-a583-40dc-82be-e28cf6be90b6 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:34.530559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5789-a583-40dc-82be-e28cf6be90b6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:34.530998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b5789-a583-40dc-82be-e28cf6be90b6 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:34.532930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 112/218] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:34.539041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c757f2-81c8-47f5-b725-beae316eb958 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:34.539967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c757f2-81c8-47f5-b725-beae316eb958 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:34.540408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c757f2-81c8-47f5-b725-beae316eb958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:34.566259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a1c757f2-81c8-47f5-b725-beae316eb958 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:34.568130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a1c757f2-81c8-47f5-b725-beae316eb958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:34.609244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:34.638638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3627a2-3367-4191-9b65-e7b3ae7a58bf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:34.663962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 113/219] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:34.685917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438244a-1dc9-4543-9534-c6ce60144b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:34.686562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438244a-1dc9-4543-9534-c6ce60144b42 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:34.686805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438244a-1dc9-4543-9534-c6ce60144b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:34.687072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438244a-1dc9-4543-9534-c6ce60144b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:34.757162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438244a-1dc9-4543-9534-c6ce60144b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:34.758530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438244a-1dc9-4543-9534-c6ce60144b42 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:34.850801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:34.872090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 107/220] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:34.877401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c757f2-81c8-47f5-b725-beae316eb958 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:34.916456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:34.949829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438244a-1dc9-4543-9534-c6ce60144b42 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:34.992261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c757f2-81c8-47f5-b725-beae316eb958 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:35.031957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54af81a-a508-4e2a-8ffa-aa3172fd2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:35.032517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54af81a-a508-4e2a-8ffa-aa3172fd2234 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:35.032789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54af81a-a508-4e2a-8ffa-aa3172fd2234 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:35.033057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54af81a-a508-4e2a-8ffa-aa3172fd2234 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:35.034706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54af81a-a508-4e2a-8ffa-aa3172fd2234 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:35.036642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54af81a-a508-4e2a-8ffa-aa3172fd2234 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:35.038879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 114/221] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:34 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:35.044753 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54af81a-a508-4e2a-8ffa-aa3172fd2234 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:35.105434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438244a-1dc9-4543-9534-c6ce60144b42 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:35.153342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df8d15-6592-47df-88c1-2d353aac391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:35.154290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8d15-6592-47df-88c1-2d353aac391f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:35.154568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8d15-6592-47df-88c1-2d353aac391f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:35.154841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df8d15-6592-47df-88c1-2d353aac391f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:35.170726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df8d15-6592-47df-88c1-2d353aac391f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-63df8d15-6592-47df-88c1-2d353aac391f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:35.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:35.176602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:35.177526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 108/222] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:35.178652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea533a-1053-4566-898f-98ac3d0f15a8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:35.178743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea533a-1053-4566-898f-98ac3d0f15a8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:35.182534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea533a-1053-4566-898f-98ac3d0f15a8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:35.182534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 109/223] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:35.186071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea533a-1053-4566-898f-98ac3d0f15a8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:35.201134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54af81a-a508-4e2a-8ffa-aa3172fd2234 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:35.202436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:35.242654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:35.248054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218f890-253e-4beb-bdc8-081351a06ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:35.248691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f890-253e-4beb-bdc8-081351a06ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:35.248989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f890-253e-4beb-bdc8-081351a06ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:35.249551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f890-253e-4beb-bdc8-081351a06ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:35.250294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218f890-253e-4beb-bdc8-081351a06ee8 None admin] RBAC: Adding query filter params (role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=1be4be6e21b140929ca372bd03dc82ab, user.id=17cd928b6f814c88957c4213a3acfb27) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:35.250604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218f890-253e-4beb-bdc8-081351a06ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:35.252715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218f890-253e-4beb-bdc8-081351a06ee8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:35.259872 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 115/224] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:35 2022] GET /identity/v3/role_assignments?user.id=17cd928b6f814c88957c4213a3acfb27&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:35.262058 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33146b-3db6-4643-9c1f-592ebcb65564 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:35.262339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33146b-3db6-4643-9c1f-592ebcb65564 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:35.262611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33146b-3db6-4643-9c1f-592ebcb65564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:35.287465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fa33146b-3db6-4643-9c1f-592ebcb65564 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:35.297020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fa33146b-3db6-4643-9c1f-592ebcb65564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:35.350215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea533a-1053-4566-898f-98ac3d0f15a8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:35.422454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:35.423074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:35.423353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:35.423622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:35.424296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:35.424598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:35.426161 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:35.432539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 116/225] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:35.435502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 110/226] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:35.440669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33146b-3db6-4643-9c1f-592ebcb65564 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:35.545197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:35.549644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33146b-3db6-4643-9c1f-592ebcb65564 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:35.591311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19526eb8-49ec-4c54-beb4-0f2ff45e856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:35.591945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526eb8-49ec-4c54-beb4-0f2ff45e856d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:35.592216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526eb8-49ec-4c54-beb4-0f2ff45e856d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:35.592481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526eb8-49ec-4c54-beb4-0f2ff45e856d None admin] PATH_INFO: `/v3/users/de189192f50b4598a9e15d80565c241c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:35.593625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19526eb8-49ec-4c54-beb4-0f2ff45e856d None admin] RBAC: Authorizing `identity:get_user(user_id=de189192f50b4598a9e15d80565c241c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:35.595052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19526eb8-49ec-4c54-beb4-0f2ff45e856d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:35.596912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 117/227] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:35 2022] GET /identity/v3/users/de189192f50b4598a9e15d80565c241c => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:35.602742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:35.757233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19526eb8-49ec-4c54-beb4-0f2ff45e856d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:35.763420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b77c8-be99-47c4-8333-b19db7ef0922 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:35.776180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:35.814669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28142a-5566-42cb-85fb-f6816c894c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:35.815410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28142a-5566-42cb-85fb-f6816c894c34 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:35.815692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28142a-5566-42cb-85fb-f6816c894c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:35.815961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28142a-5566-42cb-85fb-f6816c894c34 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:35.817457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28142a-5566-42cb-85fb-f6816c894c34 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:35.819045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28142a-5566-42cb-85fb-f6816c894c34 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:35.820926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 111/228] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:35 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:35.826541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28142a-5566-42cb-85fb-f6816c894c34 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:35.939874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19526eb8-49ec-4c54-beb4-0f2ff45e856d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:35.981414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28142a-5566-42cb-85fb-f6816c894c34 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:36.020081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01c14-bcdd-431e-90d7-4e468d53be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:36.020927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01c14-bcdd-431e-90d7-4e468d53be7b None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:36.021239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01c14-bcdd-431e-90d7-4e468d53be7b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:36.021511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec01c14-bcdd-431e-90d7-4e468d53be7b None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab/users/de189192f50b4598a9e15d80565c241c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:36.025042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec01c14-bcdd-431e-90d7-4e468d53be7b None admin] RBAC: Authorizing `identity:create_grant(project_id=1be4be6e21b140929ca372bd03dc82ab, user_id=de189192f50b4598a9e15d80565c241c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:36.026538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec01c14-bcdd-431e-90d7-4e468d53be7b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:36.031869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592feb82-b1cc-4de4-878a-fa57fdbc4b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:36.032511 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592feb82-b1cc-4de4-878a-fa57fdbc4b36 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:36.032791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592feb82-b1cc-4de4-878a-fa57fdbc4b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:36.033064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592feb82-b1cc-4de4-878a-fa57fdbc4b36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:36.046064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592feb82-b1cc-4de4-878a-fa57fdbc4b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:36.054478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 112/229] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:35 2022] PUT /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab/users/de189192f50b4598a9e15d80565c241c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-592feb82-b1cc-4de4-878a-fa57fdbc4b36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:36.058013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:36.058946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:36.059755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 118/230] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:36.067265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01c14-bcdd-431e-90d7-4e468d53be7b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:36.110472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:36.209624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec01c14-bcdd-431e-90d7-4e468d53be7b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:36.253467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:36.254420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:36.254838 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:36.255196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:36.256330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:36.256725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:36.259003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:36.268242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 113/231] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:36.274076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592feb82-b1cc-4de4-878a-fa57fdbc4b36 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:36.311310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:36.388544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592feb82-b1cc-4de4-878a-fa57fdbc4b36 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:36.434332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fda8-2dae-4004-b958-d0230aafb905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:36.434980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fda8-2dae-4004-b958-d0230aafb905 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:36.435256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fda8-2dae-4004-b958-d0230aafb905 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:36.435526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fda8-2dae-4004-b958-d0230aafb905 None admin] PATH_INFO: `/v3/users/de189192f50b4598a9e15d80565c241c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:36.436714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340fda8-2dae-4004-b958-d0230aafb905 None admin] RBAC: Authorizing `identity:get_user(user_id=de189192f50b4598a9e15d80565c241c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:36.438240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340fda8-2dae-4004-b958-d0230aafb905 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:36.440126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 119/232] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:36 2022] GET /identity/v3/users/de189192f50b4598a9e15d80565c241c => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:36.445892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:36.575224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:36.587315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0363de-931d-4c26-8eb5-4f812cd99914 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:36.632128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f6b29-dbbf-46b8-bb08-77e7a24e4590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:36.632843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6b29-dbbf-46b8-bb08-77e7a24e4590 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:36.633156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6b29-dbbf-46b8-bb08-77e7a24e4590 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:36.633435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f6b29-dbbf-46b8-bb08-77e7a24e4590 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:36.634667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f6b29-dbbf-46b8-bb08-77e7a24e4590 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:36.636147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f6b29-dbbf-46b8-bb08-77e7a24e4590 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:36.638128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 114/233] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:36 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:36.644621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fda8-2dae-4004-b958-d0230aafb905 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:36.786117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:36.797535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fda8-2dae-4004-b958-d0230aafb905 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:36.838909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79048f3-581b-4c60-b29f-8b97702ec6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:36.839950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79048f3-581b-4c60-b29f-8b97702ec6f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:36.840443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79048f3-581b-4c60-b29f-8b97702ec6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:36.840906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79048f3-581b-4c60-b29f-8b97702ec6f4 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab/users/de189192f50b4598a9e15d80565c241c/roles/3fa1cdc33cf343228f9d443a59102f22` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:36.846913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79048f3-581b-4c60-b29f-8b97702ec6f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be4be6e21b140929ca372bd03dc82ab, user_id=de189192f50b4598a9e15d80565c241c, role_id=3fa1cdc33cf343228f9d443a59102f22)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:36.848687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79048f3-581b-4c60-b29f-8b97702ec6f4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:36.875972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 120/234] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:36 2022] PUT /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab/users/de189192f50b4598a9e15d80565c241c/roles/3fa1cdc33cf343228f9d443a59102f22 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:36.960350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bf002-b91e-4fab-9d7a-836d54de5237 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:36.960861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bf002-b91e-4fab-9d7a-836d54de5237 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:36.960861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bf002-b91e-4fab-9d7a-836d54de5237 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:36.962437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 115/235] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:36.967745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed6d95-1b44-434b-af5f-e1910b7003e7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:36.968029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed6d95-1b44-434b-af5f-e1910b7003e7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:36.968369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed6d95-1b44-434b-af5f-e1910b7003e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:36.994577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-75ed6d95-1b44-434b-af5f-e1910b7003e7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:36.995780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-75ed6d95-1b44-434b-af5f-e1910b7003e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:37.047499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eba9eb-18df-4985-89ac-5f2abc0fb7aa None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:37.047804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eba9eb-18df-4985-89ac-5f2abc0fb7aa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:37.048054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eba9eb-18df-4985-89ac-5f2abc0fb7aa None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:37.049677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 116/236] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:37.056891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d038-49e8-4fe1-8deb-bab181cbc1d0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:37.057208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d038-49e8-4fe1-8deb-bab181cbc1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:37.057527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43d038-49e8-4fe1-8deb-bab181cbc1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:37.084035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 121/237] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:37.087942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5c43d038-49e8-4fe1-8deb-bab181cbc1d0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:37.089425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c43d038-49e8-4fe1-8deb-bab181cbc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:37.163502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 117/238] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:37.433273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed6d95-1b44-434b-af5f-e1910b7003e7 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:37.491248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43d038-49e8-4fe1-8deb-bab181cbc1d0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:37.534288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:37.568210 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed6d95-1b44-434b-af5f-e1910b7003e7 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:37.611141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:37.620896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43d038-49e8-4fe1-8deb-bab181cbc1d0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:37.634012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ac4a8-ef4b-42c7-8765-89eb248d7ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:37.634466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac4a8-ef4b-42c7-8765-89eb248d7ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:37.634930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac4a8-ef4b-42c7-8765-89eb248d7ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:37.635034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ac4a8-ef4b-42c7-8765-89eb248d7ba8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:37.641783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ac4a8-ef4b-42c7-8765-89eb248d7ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:37.643266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ac4a8-ef4b-42c7-8765-89eb248d7ba8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:37.645168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 122/239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:37.658071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ac4a8-ef4b-42c7-8765-89eb248d7ba8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:37.666146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9651ce-bdff-4ddd-9810-309d1bbd32f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:37.667057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9651ce-bdff-4ddd-9810-309d1bbd32f7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:37.667534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9651ce-bdff-4ddd-9810-309d1bbd32f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:37.668003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9651ce-bdff-4ddd-9810-309d1bbd32f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:37.680347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9651ce-bdff-4ddd-9810-309d1bbd32f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cb9651ce-bdff-4ddd-9810-309d1bbd32f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:37.686216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:37.687152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:37.687981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:37.690747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 118/240] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:37.697692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b937-0d94-484d-a890-bd0b7d5c30d3 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:37.698052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b937-0d94-484d-a890-bd0b7d5c30d3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:37.698418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7b937-0d94-484d-a890-bd0b7d5c30d3 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:37.700025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 119/241] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:37.700702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7b937-0d94-484d-a890-bd0b7d5c30d3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:37.784689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ac4a8-ef4b-42c7-8765-89eb248d7ba8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:37.824558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de665cfe-3185-4ac2-8d89-bf7713ebc6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:37.825050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665cfe-3185-4ac2-8d89-bf7713ebc6b7 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:37.825500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665cfe-3185-4ac2-8d89-bf7713ebc6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:37.825849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de665cfe-3185-4ac2-8d89-bf7713ebc6b7 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:37.826558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de665cfe-3185-4ac2-8d89-bf7713ebc6b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:37.828303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de665cfe-3185-4ac2-8d89-bf7713ebc6b7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:37.829309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7b937-0d94-484d-a890-bd0b7d5c30d3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:37.857295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 123/242] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:05:37 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:05:37.858930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c683b22-1930-4c40-8fe0-60b71be18c2a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:37.859405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c683b22-1930-4c40-8fe0-60b71be18c2a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:37.859856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c683b22-1930-4c40-8fe0-60b71be18c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:37.885529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:37.886528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:37.886971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:37.887443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:37.888330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:37.890261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:37.892453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:37.900968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-5c683b22-1930-4c40-8fe0-60b71be18c2a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:37.902549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5c683b22-1930-4c40-8fe0-60b71be18c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:37.908209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:37.911322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 120/243] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:37.918021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:37.948704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:38.039020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 124/244] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:38.087292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12eb0d-0f9e-4fff-b9fc-72ccfaeab0d3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:38.122722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893ee2f-be0d-4ffd-b6cc-abec6aec60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:38.123361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893ee2f-be0d-4ffd-b6cc-abec6aec60dc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:38.123633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893ee2f-be0d-4ffd-b6cc-abec6aec60dc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:38.123940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893ee2f-be0d-4ffd-b6cc-abec6aec60dc None admin] PATH_INFO: `/v3/users/bed7068037a3475b89486bc7fcdc46b1` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:38.143852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893ee2f-be0d-4ffd-b6cc-abec6aec60dc None admin] RBAC: Authorizing `identity:get_user(user_id=bed7068037a3475b89486bc7fcdc46b1)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:38.145953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893ee2f-be0d-4ffd-b6cc-abec6aec60dc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:38.147756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 121/245] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:37 2022] GET /identity/v3/users/bed7068037a3475b89486bc7fcdc46b1 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:38.153797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c683b22-1930-4c40-8fe0-60b71be18c2a None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:38.271683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c683b22-1930-4c40-8fe0-60b71be18c2a None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:38.312718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7e7e5-beeb-437f-929f-49c53cd187fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:38.313373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7e7e5-beeb-437f-929f-49c53cd187fb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:38.313652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7e7e5-beeb-437f-929f-49c53cd187fb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:38.313923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7e7e5-beeb-437f-929f-49c53cd187fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:38.324532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:38.392572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7e7e5-beeb-437f-929f-49c53cd187fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:38.394060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7e7e5-beeb-437f-929f-49c53cd187fb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:38.426891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893ee2f-be0d-4ffd-b6cc-abec6aec60dc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:38.531100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:38.532483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 125/246] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:38.533871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7e7e5-beeb-437f-929f-49c53cd187fb None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:38.563584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893ee2f-be0d-4ffd-b6cc-abec6aec60dc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:38.575674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:38.610431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a51650-da91-4956-a9b3-061917022003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:38.611453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a51650-da91-4956-a9b3-061917022003 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:38.611951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a51650-da91-4956-a9b3-061917022003 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:38.612420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a51650-da91-4956-a9b3-061917022003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:38.626441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a51650-da91-4956-a9b3-061917022003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-89a51650-da91-4956-a9b3-061917022003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:38.632238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:38.633387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:38.634436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:38.636901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 122/247] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:38.638290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a672-109b-418d-911f-4011cb3766f7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:38.638575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a672-109b-418d-911f-4011cb3766f7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:38.639171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a672-109b-418d-911f-4011cb3766f7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:38.640565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 123/248] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:38.641026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7e7e5-beeb-437f-929f-49c53cd187fb None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:38.650528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392da7-37e4-4dc5-ae31-62312573a5c0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:38.650856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392da7-37e4-4dc5-ae31-62312573a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:38.651125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392da7-37e4-4dc5-ae31-62312573a5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:38.675134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a3392da7-37e4-4dc5-ae31-62312573a5c0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:38.677026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a3392da7-37e4-4dc5-ae31-62312573a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:38.682024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951a22-a069-4f0a-8d20-982b04415fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:38.682673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951a22-a069-4f0a-8d20-982b04415fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:38.682950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951a22-a069-4f0a-8d20-982b04415fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:38.683222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b951a22-a069-4f0a-8d20-982b04415fe5 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:38.685470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b951a22-a069-4f0a-8d20-982b04415fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:38.686907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b951a22-a069-4f0a-8d20-982b04415fe5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:38.688571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 126/249] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:38 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:38.695294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951a22-a069-4f0a-8d20-982b04415fe5 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:38.760561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 124/250] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:38.762045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3392da7-37e4-4dc5-ae31-62312573a5c0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:38.838434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b951a22-a069-4f0a-8d20-982b04415fe5 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:38.848378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:38.882614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:38.886671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:38.887299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:38.887576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:38.887847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:38.888519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:38.889154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:38.890535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:38.907932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 127/251] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:38.914015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:38.959421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3392da7-37e4-4dc5-ae31-62312573a5c0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:39.019293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:39.020327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.020654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.020930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.021717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] RBAC: Adding query filter params (role.id=48a551b7e05445ceb37de851862f0cc8, scope.project.id=1be4be6e21b140929ca372bd03dc82ab, user.id=bed7068037a3475b89486bc7fcdc46b1) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:39.022025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:39.023491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:39.035707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 125/252] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:38 2022] GET /identity/v3/role_assignments?user.id=bed7068037a3475b89486bc7fcdc46b1&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=48a551b7e05445ceb37de851862f0cc8 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:39.075439 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e322e-96ee-4a4e-8eb7-f1810ce45110 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:39.111981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff439ef-28ac-4d8d-980d-5484ce7148d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:39.112590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff439ef-28ac-4d8d-980d-5484ce7148d5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.112870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff439ef-28ac-4d8d-980d-5484ce7148d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.113188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff439ef-28ac-4d8d-980d-5484ce7148d5 None admin] PATH_INFO: `/v3/users/17cd928b6f814c88957c4213a3acfb27` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.115179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff439ef-28ac-4d8d-980d-5484ce7148d5 None admin] RBAC: Authorizing `identity:get_user(user_id=17cd928b6f814c88957c4213a3acfb27)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:39.117162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff439ef-28ac-4d8d-980d-5484ce7148d5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:39.117913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:39.119303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 128/253] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:38 2022] GET /identity/v3/users/17cd928b6f814c88957c4213a3acfb27 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:39.127342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff439ef-28ac-4d8d-980d-5484ce7148d5 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:39.203157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:39.276971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc533619-d066-4215-852d-2afe23449f7f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:39.324137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:39.334892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff439ef-28ac-4d8d-980d-5484ce7148d5 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:39.340684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b769fda-7f32-46b9-86e6-1a685da15014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:39.341367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b769fda-7f32-46b9-86e6-1a685da15014 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.341645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b769fda-7f32-46b9-86e6-1a685da15014 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.341916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b769fda-7f32-46b9-86e6-1a685da15014 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.352946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b769fda-7f32-46b9-86e6-1a685da15014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1b769fda-7f32-46b9-86e6-1a685da15014 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:39.360514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:39.361583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:39.362467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 126/254] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:39.366341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b769fda-7f32-46b9-86e6-1a685da15014 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:39.418772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da652161-521d-428d-a513-6a97f1f2792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:39.419425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da652161-521d-428d-a513-6a97f1f2792c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.419706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da652161-521d-428d-a513-6a97f1f2792c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.419977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da652161-521d-428d-a513-6a97f1f2792c None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.426267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da652161-521d-428d-a513-6a97f1f2792c None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:39.428956 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da652161-521d-428d-a513-6a97f1f2792c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:39.430706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 129/255] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:39 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:39.433938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6447c-113a-4fc2-babd-719f89546f61 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.434221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6447c-113a-4fc2-babd-719f89546f61 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.434499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6447c-113a-4fc2-babd-719f89546f61 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.436005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 130/256] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:39.439951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6447c-113a-4fc2-babd-719f89546f61 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:39.531156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b769fda-7f32-46b9-86e6-1a685da15014 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:39.585127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6c3ae-8637-456a-af39-5bb2446c00b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:39.585756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6c3ae-8637-456a-af39-5bb2446c00b5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.586038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6c3ae-8637-456a-af39-5bb2446c00b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.586314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6c3ae-8637-456a-af39-5bb2446c00b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.586997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6c3ae-8637-456a-af39-5bb2446c00b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:39.587304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6c3ae-8637-456a-af39-5bb2446c00b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:39.588697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6c3ae-8637-456a-af39-5bb2446c00b5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:39.599511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 127/257] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:39.605719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a8ab-2136-4296-be7a-204e9cabd49f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.606017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a8ab-2136-4296-be7a-204e9cabd49f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.606320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8a8ab-2136-4296-be7a-204e9cabd49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.627039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dde8a8ab-2136-4296-be7a-204e9cabd49f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:39.628158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dde8a8ab-2136-4296-be7a-204e9cabd49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:39.684601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:39.704267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 128/258] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:39.714357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6447c-113a-4fc2-babd-719f89546f61 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:39.714504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a8ab-2136-4296-be7a-204e9cabd49f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:39.723508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:39.822766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d2e6-404e-481f-a921-2a532429449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:39.823456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d2e6-404e-481f-a921-2a532429449d None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.823739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d2e6-404e-481f-a921-2a532429449d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.824015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d2e6-404e-481f-a921-2a532429449d None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab/users/17cd928b6f814c88957c4213a3acfb27/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.825985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d2e6-404e-481f-a921-2a532429449d None admin] RBAC: Authorizing `identity:create_grant(project_id=1be4be6e21b140929ca372bd03dc82ab, user_id=17cd928b6f814c88957c4213a3acfb27, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:39.827426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d2e6-404e-481f-a921-2a532429449d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:39.860395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 131/259] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:39 2022] PUT /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab/users/17cd928b6f814c88957c4213a3acfb27/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:05:39.884549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8a8ab-2136-4296-be7a-204e9cabd49f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:39.942432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d731a-eebe-43b7-b9e1-0b9949baf6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:39.943461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d731a-eebe-43b7-b9e1-0b9949baf6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:39.943958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d731a-eebe-43b7-b9e1-0b9949baf6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:39.944474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d731a-eebe-43b7-b9e1-0b9949baf6b2 None admin] PATH_INFO: `/v3/users/de189192f50b4598a9e15d80565c241c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:39.949415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d731a-eebe-43b7-b9e1-0b9949baf6b2 None admin] RBAC: Authorizing `identity:get_user(user_id=de189192f50b4598a9e15d80565c241c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:39.951270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d731a-eebe-43b7-b9e1-0b9949baf6b2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:39.953459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 129/260] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:39 2022] GET /identity/v3/users/de189192f50b4598a9e15d80565c241c => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:39.960214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d2e6-404e-481f-a921-2a532429449d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:40.105843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d2e6-404e-481f-a921-2a532429449d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:40.111715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d731a-eebe-43b7-b9e1-0b9949baf6b2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:40.162015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d4c85-d268-4e92-8183-ee0a0f4020d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:40.162555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4c85-d268-4e92-8183-ee0a0f4020d5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:40.162833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4c85-d268-4e92-8183-ee0a0f4020d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:40.163104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4c85-d268-4e92-8183-ee0a0f4020d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:40.190620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:40.215685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:40.278397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d4c85-d268-4e92-8183-ee0a0f4020d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:40.279864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d4c85-d268-4e92-8183-ee0a0f4020d5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:40.291061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d731a-eebe-43b7-b9e1-0b9949baf6b2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:40.350307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5089b9-f8c5-442f-b81a-c6016554b0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:40.350957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5089b9-f8c5-442f-b81a-c6016554b0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:40.351232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5089b9-f8c5-442f-b81a-c6016554b0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:40.351499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5089b9-f8c5-442f-b81a-c6016554b0b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:40.368721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5089b9-f8c5-442f-b81a-c6016554b0b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-fc5089b9-f8c5-442f-b81a-c6016554b0b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:40.374720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:40.375606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:40.376411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 130/261] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:40.384890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5089b9-f8c5-442f-b81a-c6016554b0b1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:40.463430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 132/262] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:40.469493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d4c85-d268-4e92-8183-ee0a0f4020d5 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:40.561816 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5089b9-f8c5-442f-b81a-c6016554b0b1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:40.570899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:40.579290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:40.627408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:40.628044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:40.628314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:40.629119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:40.629376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:40.629685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:40.631103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:40.644986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 131/263] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:40.645870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d4c85-d268-4e92-8183-ee0a0f4020d5 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:40.652078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:40.683344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a80d12-5fa9-4300-a7cf-d11ef1bf4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:40.684156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a80d12-5fa9-4300-a7cf-d11ef1bf4245 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:40.684434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a80d12-5fa9-4300-a7cf-d11ef1bf4245 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:40.684705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a80d12-5fa9-4300-a7cf-d11ef1bf4245 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:40.686122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a80d12-5fa9-4300-a7cf-d11ef1bf4245 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:40.687659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a80d12-5fa9-4300-a7cf-d11ef1bf4245 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:40.689657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 133/264] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:40 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:40.698724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a80d12-5fa9-4300-a7cf-d11ef1bf4245 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:40.860786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de3a1d-edcb-4676-a338-6b716e81fe2f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:40.874388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a80d12-5fa9-4300-a7cf-d11ef1bf4245 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:40.910022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:40.916699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:40.917354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:40.917635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:40.917909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:40.918651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=1be4be6e21b140929ca372bd03dc82ab, user.id=de189192f50b4598a9e15d80565c241c) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:40.918957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:40.920462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:40.928265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 134/265] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:40 2022] GET /identity/v3/role_assignments?user.id=de189192f50b4598a9e15d80565c241c&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=6da07502c09e4fc8afb31b58e434479b => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:40.942623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e67e2-42db-4c34-bd78-2cc14b3a26ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:40.943296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e67e2-42db-4c34-bd78-2cc14b3a26ba None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:40.943576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e67e2-42db-4c34-bd78-2cc14b3a26ba None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:40.943852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e67e2-42db-4c34-bd78-2cc14b3a26ba None admin] PATH_INFO: `/v3/users/de189192f50b4598a9e15d80565c241c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:40.949799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e67e2-42db-4c34-bd78-2cc14b3a26ba None admin] RBAC: Authorizing `identity:get_user(user_id=de189192f50b4598a9e15d80565c241c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:40.951313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e67e2-42db-4c34-bd78-2cc14b3a26ba None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:40.953368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 132/266] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:40 2022] GET /identity/v3/users/de189192f50b4598a9e15d80565c241c => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:40.959429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:41.074068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a5c3b-6c22-4dd4-be94-5064a6fdd20f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:41.109117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc542231-0458-44c6-976e-86bacf3d5f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:41.109753 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542231-0458-44c6-976e-86bacf3d5f23 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.110030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542231-0458-44c6-976e-86bacf3d5f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.110304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc542231-0458-44c6-976e-86bacf3d5f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.184503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:41.192000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc542231-0458-44c6-976e-86bacf3d5f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:41.194485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc542231-0458-44c6-976e-86bacf3d5f23 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:41.257928 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548e053-7886-483d-aec1-9938ea74ecb3 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.258438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548e053-7886-483d-aec1-9938ea74ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.258545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548e053-7886-483d-aec1-9938ea74ecb3 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.259816 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 133/267] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:41.270315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52453939-9196-4c67-aad8-9200eda6aba3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.270588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52453939-9196-4c67-aad8-9200eda6aba3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.270862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52453939-9196-4c67-aad8-9200eda6aba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.302601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-52453939-9196-4c67-aad8-9200eda6aba3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:41.303827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-52453939-9196-4c67-aad8-9200eda6aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:41.347076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 135/268] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:41.353495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc542231-0458-44c6-976e-86bacf3d5f23 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:41.356829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:41.430802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 134/269] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:41.432179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50c05-818b-4621-add2-24cc6bf4c0ce None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.432491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50c05-818b-4621-add2-24cc6bf4c0ce None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.432871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf50c05-818b-4621-add2-24cc6bf4c0ce None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.434400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 135/270] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:41.439818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766700-a541-4f7f-9436-9e59b67cee41 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.440037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766700-a541-4f7f-9436-9e59b67cee41 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.440304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26766700-a541-4f7f-9436-9e59b67cee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.462052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-26766700-a541-4f7f-9436-9e59b67cee41 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:41.463251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26766700-a541-4f7f-9436-9e59b67cee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:41.488505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:41.496894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc542231-0458-44c6-976e-86bacf3d5f23 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:41.539128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 136/271] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:41.556500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4fc39-bde0-4226-8a3f-d80e451061f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:41.557529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fc39-bde0-4226-8a3f-d80e451061f0 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.558000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fc39-bde0-4226-8a3f-d80e451061f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.558482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fc39-bde0-4226-8a3f-d80e451061f0 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.559795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4fc39-bde0-4226-8a3f-d80e451061f0 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:41.561448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4fc39-bde0-4226-8a3f-d80e451061f0 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:41.568227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 136/272] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:41 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:41.569888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766700-a541-4f7f-9436-9e59b67cee41 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:41.681851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:41.688033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26766700-a541-4f7f-9436-9e59b67cee41 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:41.723096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872c6ca-63b3-4132-8784-956eac830c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:41.723680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872c6ca-63b3-4132-8784-956eac830c76 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.723960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872c6ca-63b3-4132-8784-956eac830c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.724235 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872c6ca-63b3-4132-8784-956eac830c76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.724966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872c6ca-63b3-4132-8784-956eac830c76 None admin] RBAC: Adding query filter params (role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=1be4be6e21b140929ca372bd03dc82ab, user.id=de189192f50b4598a9e15d80565c241c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:41.725306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872c6ca-63b3-4132-8784-956eac830c76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:41.726767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872c6ca-63b3-4132-8784-956eac830c76 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:41.733322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 137/273] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:41 2022] GET /identity/v3/role_assignments?user.id=de189192f50b4598a9e15d80565c241c&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:41.883350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55930b-fd1f-4835-8ecb-01f7f2056246 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.883738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55930b-fd1f-4835-8ecb-01f7f2056246 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.883913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55930b-fd1f-4835-8ecb-01f7f2056246 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.885268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 137/274] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:41.903315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b34d-2738-4dee-91ed-0712207c35dc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:41.903650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b34d-2738-4dee-91ed-0712207c35dc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:41.903870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548b34d-2738-4dee-91ed-0712207c35dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:41.913497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55930b-fd1f-4835-8ecb-01f7f2056246 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:41.926453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7548b34d-2738-4dee-91ed-0712207c35dc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:41.927657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7548b34d-2738-4dee-91ed-0712207c35dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:42.004348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 138/275] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:42.005704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548b34d-2738-4dee-91ed-0712207c35dc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:42.043697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55930b-fd1f-4835-8ecb-01f7f2056246 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:42.083674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63521dd6-aea2-48d0-9e8a-c59c0a0e7680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:42.084310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63521dd6-aea2-48d0-9e8a-c59c0a0e7680 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.084583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63521dd6-aea2-48d0-9e8a-c59c0a0e7680 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.084850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63521dd6-aea2-48d0-9e8a-c59c0a0e7680 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.096282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63521dd6-aea2-48d0-9e8a-c59c0a0e7680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-63521dd6-aea2-48d0-9e8a-c59c0a0e7680 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:42.103924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:42.104870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:42.105757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 138/276] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:42.112064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63521dd6-aea2-48d0-9e8a-c59c0a0e7680 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:42.132800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:42.141820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:42.149268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548b34d-2738-4dee-91ed-0712207c35dc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:42.192703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571782-6bc2-44c4-a7d7-236bb85747d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:42.193481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571782-6bc2-44c4-a7d7-236bb85747d4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.193821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571782-6bc2-44c4-a7d7-236bb85747d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.194099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571782-6bc2-44c4-a7d7-236bb85747d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.195284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e571782-6bc2-44c4-a7d7-236bb85747d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:42.196859 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e571782-6bc2-44c4-a7d7-236bb85747d4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:42.199584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 139/277] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:42.209146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571782-6bc2-44c4-a7d7-236bb85747d4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:42.241022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63521dd6-aea2-48d0-9e8a-c59c0a0e7680 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:42.291329 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:42.291919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.292203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.292521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.293474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:42.293779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:42.296035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:42.307680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 139/278] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:42.313266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:42.332251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571782-6bc2-44c4-a7d7-236bb85747d4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:42.367741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63579bab-d143-4d17-bcbf-b4fa7e6588d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:42.368363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579bab-d143-4d17-bcbf-b4fa7e6588d2 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.368637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579bab-d143-4d17-bcbf-b4fa7e6588d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.368912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579bab-d143-4d17-bcbf-b4fa7e6588d2 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.369596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63579bab-d143-4d17-bcbf-b4fa7e6588d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:42.371041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63579bab-d143-4d17-bcbf-b4fa7e6588d2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:42.394711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 140/279] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:05:42 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:05:42.395557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63579bab-d143-4d17-bcbf-b4fa7e6588d2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:42.418203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:42.421553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:42.442470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bcda7-da9c-48ae-8e54-725d80bc794f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:42.480591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b864e-03e5-4ea4-8065-79d8e8b9a6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:42.481276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b864e-03e5-4ea4-8065-79d8e8b9a6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.481556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b864e-03e5-4ea4-8065-79d8e8b9a6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.481825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b864e-03e5-4ea4-8065-79d8e8b9a6a0 None admin] PATH_INFO: `/v3/users/94c692a306ed4c6895441580abf15ab9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.497747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b864e-03e5-4ea4-8065-79d8e8b9a6a0 None admin] RBAC: Authorizing `identity:get_user(user_id=94c692a306ed4c6895441580abf15ab9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:42.499132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b864e-03e5-4ea4-8065-79d8e8b9a6a0 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:42.501023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 140/280] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:42 2022] GET /identity/v3/users/94c692a306ed4c6895441580abf15ab9 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:42.502113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc8aa3-b9e4-44af-98ed-e3b5716d1768 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.502394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc8aa3-b9e4-44af-98ed-e3b5716d1768 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.502664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc8aa3-b9e4-44af-98ed-e3b5716d1768 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.504084 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 141/281] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:42.508855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc8aa3-b9e4-44af-98ed-e3b5716d1768 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:42.531016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63579bab-d143-4d17-bcbf-b4fa7e6588d2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:42.568552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ad7d7-c4fc-4935-b3af-facc24fbb4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:42.569234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ad7d7-c4fc-4935-b3af-facc24fbb4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.569511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ad7d7-c4fc-4935-b3af-facc24fbb4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.569782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ad7d7-c4fc-4935-b3af-facc24fbb4a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.580065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ad7d7-c4fc-4935-b3af-facc24fbb4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9b0ad7d7-c4fc-4935-b3af-facc24fbb4a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:42.585781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:42.586698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:42.587516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:42.588608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 141/282] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:42.589403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208d2a-21b8-4808-9786-633802e0a63e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.589686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208d2a-21b8-4808-9786-633802e0a63e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.589957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b208d2a-21b8-4808-9786-633802e0a63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.609544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6b208d2a-21b8-4808-9786-633802e0a63e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:42.610751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6b208d2a-21b8-4808-9786-633802e0a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:42.631903 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc8aa3-b9e4-44af-98ed-e3b5716d1768 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:42.677355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:42.677980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.678259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.678531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.679270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] RBAC: Adding query filter params (role.id=d2a6b97a907440368eca7f9387b778d6, user.id=94c692a306ed4c6895441580abf15ab9, scope.system=all) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:42.679579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:42.681012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:42.688014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 142/283] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 31 05:05:42 2022] GET /identity/v3/role_assignments?user.id=94c692a306ed4c6895441580abf15ab9&scope.system=all&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:42.688852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:42.700995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:42.701251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 142/284] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:42.829623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de1ff9-497f-44f4-9319-3844fafb4dc3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:42.873241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:42.873858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:42.874136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:42.874407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:42.875075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:42.875374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:42.876737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:42.886014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 143/285] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:42.892066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b208d2a-21b8-4808-9786-633802e0a63e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:42.897359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:43.014743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:43.015754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b208d2a-21b8-4808-9786-633802e0a63e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:43.051339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508000fe-8d78-48bb-9733-bcceac849f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:43.052046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508000fe-8d78-48bb-9733-bcceac849f8c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:43.052324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508000fe-8d78-48bb-9733-bcceac849f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:43.052591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508000fe-8d78-48bb-9733-bcceac849f8c None admin] PATH_INFO: `/v3/users/bed7068037a3475b89486bc7fcdc46b1` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:43.053755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508000fe-8d78-48bb-9733-bcceac849f8c None admin] RBAC: Authorizing `identity:get_user(user_id=bed7068037a3475b89486bc7fcdc46b1)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:43.055203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508000fe-8d78-48bb-9733-bcceac849f8c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:43.057153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 143/286] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:42 2022] GET /identity/v3/users/bed7068037a3475b89486bc7fcdc46b1 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:43.070276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508000fe-8d78-48bb-9733-bcceac849f8c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:43.152564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:43.186522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:43.215640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5accc-1389-48e8-a26e-8f112473dec5 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:43.246319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508000fe-8d78-48bb-9733-bcceac849f8c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:43.296742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcb4d-6d3c-4256-8406-5f3e25357dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:43.297838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcb4d-6d3c-4256-8406-5f3e25357dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:43.298117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcb4d-6d3c-4256-8406-5f3e25357dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:43.298387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bcb4d-6d3c-4256-8406-5f3e25357dd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:43.301528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e40e-8ce0-4a33-8f90-b8c4c4ec2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:43.302169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e40e-8ce0-4a33-8f90-b8c4c4ec2c27 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:43.302444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e40e-8ce0-4a33-8f90-b8c4c4ec2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:43.302712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e40e-8ce0-4a33-8f90-b8c4c4ec2c27 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:43.303879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e40e-8ce0-4a33-8f90-b8c4c4ec2c27 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:43.305517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e40e-8ce0-4a33-8f90-b8c4c4ec2c27 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:43.307168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 144/287] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:43 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:43.313985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e40e-8ce0-4a33-8f90-b8c4c4ec2c27 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:43.322529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bcb4d-6d3c-4256-8406-5f3e25357dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-e06bcb4d-6d3c-4256-8406-5f3e25357dd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:43.328810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:43.329745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:43.330565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 144/288] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:43.337018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcb4d-6d3c-4256-8406-5f3e25357dd6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:43.454637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bcb4d-6d3c-4256-8406-5f3e25357dd6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:43.497180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:43.497999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:43.498385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:43.498740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:43.499528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:43.499927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:43.501429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:43.511270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 145/289] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:43.513541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:43.519588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:43.561531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e40e-8ce0-4a33-8f90-b8c4c4ec2c27 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:43.617771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cf178-d852-4b9e-acaa-2c42c6893a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:43.618848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cf178-d852-4b9e-acaa-2c42c6893a32 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:43.619328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cf178-d852-4b9e-acaa-2c42c6893a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:43.619799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cf178-d852-4b9e-acaa-2c42c6893a32 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab/users/bed7068037a3475b89486bc7fcdc46b1/roles/48a551b7e05445ceb37de851862f0cc8` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:43.624002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cf178-d852-4b9e-acaa-2c42c6893a32 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be4be6e21b140929ca372bd03dc82ab, user_id=bed7068037a3475b89486bc7fcdc46b1, role_id=48a551b7e05445ceb37de851862f0cc8)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:43.625750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cf178-d852-4b9e-acaa-2c42c6893a32 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:43.644915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:43.653380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 145/290] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:05:43 2022] PUT /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab/users/bed7068037a3475b89486bc7fcdc46b1/roles/48a551b7e05445ceb37de851862f0cc8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:43.703240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664feb87-0d53-4b68-9c7d-944c09c77d53 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:43.767829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb4427-e5de-4293-94a5-0fe04788f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:43.768866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4427-e5de-4293-94a5-0fe04788f87c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:43.769411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4427-e5de-4293-94a5-0fe04788f87c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:43.769921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4427-e5de-4293-94a5-0fe04788f87c None admin] PATH_INFO: `/v3/users/17cd928b6f814c88957c4213a3acfb27` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:43.771382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb4427-e5de-4293-94a5-0fe04788f87c None admin] RBAC: Authorizing `identity:get_user(user_id=17cd928b6f814c88957c4213a3acfb27)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:43.773040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb4427-e5de-4293-94a5-0fe04788f87c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:43.774952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 146/291] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:43 2022] GET /identity/v3/users/17cd928b6f814c88957c4213a3acfb27 => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:43.780827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cf178-d852-4b9e-acaa-2c42c6893a32 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:43.919158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cf178-d852-4b9e-acaa-2c42c6893a32 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:43.960268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8fcd-02a5-4046-b6af-7e16f02b5c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:43.961310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8fcd-02a5-4046-b6af-7e16f02b5c2f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:43.961786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8fcd-02a5-4046-b6af-7e16f02b5c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:43.962265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8fcd-02a5-4046-b6af-7e16f02b5c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:44.042608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:44.045979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe8fcd-02a5-4046-b6af-7e16f02b5c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:44.047970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe8fcd-02a5-4046-b6af-7e16f02b5c2f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:44.181480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 146/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:44.187305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb4427-e5de-4293-94a5-0fe04788f87c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:44.267870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:44.326066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb4427-e5de-4293-94a5-0fe04788f87c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:44.373888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47101524-f274-4bf2-8cfe-537375ccdf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:44.374532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101524-f274-4bf2-8cfe-537375ccdf61 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:44.374813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101524-f274-4bf2-8cfe-537375ccdf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:44.375086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47101524-f274-4bf2-8cfe-537375ccdf61 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:44.376226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47101524-f274-4bf2-8cfe-537375ccdf61 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:44.377700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47101524-f274-4bf2-8cfe-537375ccdf61 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:44.379555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 147/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:44 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:44.385411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8fcd-02a5-4046-b6af-7e16f02b5c2f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:44.526350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:44.530179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8fcd-02a5-4046-b6af-7e16f02b5c2f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:44.574880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a2a3c-470f-4aba-8b40-fccfacaebb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:44.575506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2a3c-470f-4aba-8b40-fccfacaebb84 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:44.575761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2a3c-470f-4aba-8b40-fccfacaebb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:44.576027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a2a3c-470f-4aba-8b40-fccfacaebb84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:44.576822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a2a3c-470f-4aba-8b40-fccfacaebb84 None admin] RBAC: Adding query filter params (role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=1be4be6e21b140929ca372bd03dc82ab, user.id=17cd928b6f814c88957c4213a3acfb27) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:44.577077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a2a3c-470f-4aba-8b40-fccfacaebb84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:44.578539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a2a3c-470f-4aba-8b40-fccfacaebb84 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:44.589930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 147/294] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:44 2022] GET /identity/v3/role_assignments?user.id=17cd928b6f814c88957c4213a3acfb27&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:44.793485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c248db-d818-4c71-8171-7564e2e7b07e None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:44.793998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c248db-d818-4c71-8171-7564e2e7b07e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:44.794074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c248db-d818-4c71-8171-7564e2e7b07e None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:44.795640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 148/295] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:44.803237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef01f4-b17c-41cf-9f32-ceec0cf20b45 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:44.803518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef01f4-b17c-41cf-9f32-ceec0cf20b45 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:44.803790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef01f4-b17c-41cf-9f32-ceec0cf20b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:44.825759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c8ef01f4-b17c-41cf-9f32-ceec0cf20b45 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:44.827019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c8ef01f4-b17c-41cf-9f32-ceec0cf20b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:44.905223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 148/296] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:44.976714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbc1d-7558-421a-ae9f-91a84a22b385 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:44.976983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbc1d-7558-421a-ae9f-91a84a22b385 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:44.977505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fbc1d-7558-421a-ae9f-91a84a22b385 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:44.979310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 149/297] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:44.984671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563d00-a762-4993-ad81-e75e1d33d650 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:44.985222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563d00-a762-4993-ad81-e75e1d33d650 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:44.985685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563d00-a762-4993-ad81-e75e1d33d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.004672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-13563d00-a762-4993-ad81-e75e1d33d650 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:45.006238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-13563d00-a762-4993-ad81-e75e1d33d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:45.081021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 149/298] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:45.191171 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbc1d-7558-421a-ae9f-91a84a22b385 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.204880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2aa86-a500-4006-8212-f14cc3562db1 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.205475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2aa86-a500-4006-8212-f14cc3562db1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.206134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2aa86-a500-4006-8212-f14cc3562db1 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.211250 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 150/299] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:45.215154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ccbf2-6b74-4285-b47a-58531c6f3ead None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.215640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ccbf2-6b74-4285-b47a-58531c6f3ead None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.216095 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ccbf2-6b74-4285-b47a-58531c6f3ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.242692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3d4ccbf2-6b74-4285-b47a-58531c6f3ead None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:45.244912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3d4ccbf2-6b74-4285-b47a-58531c6f3ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:45.270630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:45.336208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 151/300] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:45.343078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fbc1d-7558-421a-ae9f-91a84a22b385 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:45.350016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ccbf2-6b74-4285-b47a-58531c6f3ead None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.372340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:45.381712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c14e96-32e2-4cd5-ad39-3d0a3024513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:45.382468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c14e96-32e2-4cd5-ad39-3d0a3024513a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.382857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c14e96-32e2-4cd5-ad39-3d0a3024513a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.383319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c14e96-32e2-4cd5-ad39-3d0a3024513a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.395101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c14e96-32e2-4cd5-ad39-3d0a3024513a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-76c14e96-32e2-4cd5-ad39-3d0a3024513a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:45.400322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:45.401461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:45.402487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:45.408409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 150/301] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:45.409646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c14e96-32e2-4cd5-ad39-3d0a3024513a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.476128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ccbf2-6b74-4285-b47a-58531c6f3ead None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:45.513505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7bec3-072e-44e7-8883-e234924338cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:45.514490 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bec3-072e-44e7-8883-e234924338cf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.514763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bec3-072e-44e7-8883-e234924338cf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.515026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7bec3-072e-44e7-8883-e234924338cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.527589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a7bec3-072e-44e7-8883-e234924338cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-58a7bec3-072e-44e7-8883-e234924338cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:45.532627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:45.533545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:45.539510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 152/302] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:45.540178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c14e96-32e2-4cd5-ad39-3d0a3024513a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:45.540755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7bec3-072e-44e7-8883-e234924338cf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.562371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:45.578109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:45.578897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.579130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.579446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.580151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] RBAC: Adding query filter params (name=reader) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:45.580632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:45.582130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:45.595690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 151/303] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:45.596648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.652461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:45.663834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a7bec3-072e-44e7-8883-e234924338cf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:45.703742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:45.704858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.705689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.706243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.707291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:45.707906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:45.708877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859498ac-b6b4-4658-8395-27e6a58dbaee None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:45.709667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:45.725943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 153/304] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:45.725943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.749004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9725b-595e-4d1a-8ee6-97f7c8ca5b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:45.749757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9725b-595e-4d1a-8ee6-97f7c8ca5b73 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.750017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9725b-595e-4d1a-8ee6-97f7c8ca5b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.750217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9725b-595e-4d1a-8ee6-97f7c8ca5b73 None admin] PATH_INFO: `/v3/users/00008a492e4d4380a2e8f71d21a16d93` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.764474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9725b-595e-4d1a-8ee6-97f7c8ca5b73 None admin] RBAC: Authorizing `identity:get_user(user_id=00008a492e4d4380a2e8f71d21a16d93)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:45.765951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9725b-595e-4d1a-8ee6-97f7c8ca5b73 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:45.772986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 152/305] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:45 2022] GET /identity/v3/users/00008a492e4d4380a2e8f71d21a16d93 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:45.772986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9725b-595e-4d1a-8ee6-97f7c8ca5b73 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.810233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:45.836163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e80af9-9a62-44bc-9ff3-68be44b1c7ba None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:45.872094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28d490-c15b-4f2f-b10f-a3ca5dac2590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:45.872650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28d490-c15b-4f2f-b10f-a3ca5dac2590 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.872926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28d490-c15b-4f2f-b10f-a3ca5dac2590 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.873221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28d490-c15b-4f2f-b10f-a3ca5dac2590 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.874340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28d490-c15b-4f2f-b10f-a3ca5dac2590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:45.875784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28d490-c15b-4f2f-b10f-a3ca5dac2590 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:45.877536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 154/306] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:45.881924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28d490-c15b-4f2f-b10f-a3ca5dac2590 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.890250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9725b-595e-4d1a-8ee6-97f7c8ca5b73 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:45.901051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:45.927537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38c6d6-a9b7-49d3-b5bd-436b481db443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:45.928174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38c6d6-a9b7-49d3-b5bd-436b481db443 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:45.928452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38c6d6-a9b7-49d3-b5bd-436b481db443 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:45.928722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38c6d6-a9b7-49d3-b5bd-436b481db443 None admin] PATH_INFO: `/v3/users/94c692a306ed4c6895441580abf15ab9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:45.929893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38c6d6-a9b7-49d3-b5bd-436b481db443 None admin] RBAC: Authorizing `identity:get_user(user_id=94c692a306ed4c6895441580abf15ab9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:45.931330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38c6d6-a9b7-49d3-b5bd-436b481db443 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:45.932909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 153/307] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:45 2022] GET /identity/v3/users/94c692a306ed4c6895441580abf15ab9 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:45.933694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38c6d6-a9b7-49d3-b5bd-436b481db443 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:45.995568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28d490-c15b-4f2f-b10f-a3ca5dac2590 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:46.030983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713486b7-fdfa-4ec3-95c0-3d05502df923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:46.031264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38c6d6-a9b7-49d3-b5bd-436b481db443 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:46.031590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713486b7-fdfa-4ec3-95c0-3d05502df923 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:46.031869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713486b7-fdfa-4ec3-95c0-3d05502df923 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:46.032122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713486b7-fdfa-4ec3-95c0-3d05502df923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:46.032855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713486b7-fdfa-4ec3-95c0-3d05502df923 None admin] RBAC: Adding query filter params (role.id=48a551b7e05445ceb37de851862f0cc8, user.id=00008a492e4d4380a2e8f71d21a16d93, scope.system=all) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:46.033191 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713486b7-fdfa-4ec3-95c0-3d05502df923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:46.034638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713486b7-fdfa-4ec3-95c0-3d05502df923 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:46.040328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 155/308] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 31 05:05:45 2022] GET /identity/v3/role_assignments?user.id=00008a492e4d4380a2e8f71d21a16d93&scope.system=all&role.id=48a551b7e05445ceb37de851862f0cc8 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:46.041589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512e93-b215-4134-aaee-6df77a0a4140 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:46.041871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512e93-b215-4134-aaee-6df77a0a4140 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:46.042144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512e93-b215-4134-aaee-6df77a0a4140 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:46.043379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 156/309] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:46.046208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88512e93-b215-4134-aaee-6df77a0a4140 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:46.065075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:46.075558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320a1ab-abf4-4495-b2ca-b5e88dfb91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:46.076186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320a1ab-abf4-4495-b2ca-b5e88dfb91cb None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:46.076454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320a1ab-abf4-4495-b2ca-b5e88dfb91cb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:46.076720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320a1ab-abf4-4495-b2ca-b5e88dfb91cb None admin] PATH_INFO: `/v3/groups` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:46.077384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320a1ab-abf4-4495-b2ca-b5e88dfb91cb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:46.078851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320a1ab-abf4-4495-b2ca-b5e88dfb91cb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:46.099567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 154/310] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Aug 31 05:05:45 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:46.100831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536297bd-b2e7-4c0a-9520-9fbcf8cc57fc None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:46.101840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536297bd-b2e7-4c0a-9520-9fbcf8cc57fc None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:46.102086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536297bd-b2e7-4c0a-9520-9fbcf8cc57fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:46.138640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-536297bd-b2e7-4c0a-9520-9fbcf8cc57fc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:46.140464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-536297bd-b2e7-4c0a-9520-9fbcf8cc57fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:46.188264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:46.190201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88512e93-b215-4134-aaee-6df77a0a4140 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:46.234612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87b320-8225-4f9f-9090-3420c997ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:46.236062 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b320-8225-4f9f-9090-3420c997ffa0 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:46.236495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b320-8225-4f9f-9090-3420c997ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:46.237220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b320-8225-4f9f-9090-3420c997ffa0 None admin] PATH_INFO: `/v3/system/users/94c692a306ed4c6895441580abf15ab9/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:46.238980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87b320-8225-4f9f-9090-3420c997ffa0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=94c692a306ed4c6895441580abf15ab9, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:46.240554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87b320-8225-4f9f-9090-3420c997ffa0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:46.245249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 155/311] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:46.260059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 157/312] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Aug 31 05:05:46 2022] PUT /identity/v3/system/users/94c692a306ed4c6895441580abf15ab9/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:46.516937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536297bd-b2e7-4c0a-9520-9fbcf8cc57fc None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:46.614888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536297bd-b2e7-4c0a-9520-9fbcf8cc57fc None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:46.651375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61fc10-3091-4f2b-b8e9-cd20fcb1edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:46.652013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61fc10-3091-4f2b-b8e9-cd20fcb1edf7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:46.652288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61fc10-3091-4f2b-b8e9-cd20fcb1edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:46.652560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61fc10-3091-4f2b-b8e9-cd20fcb1edf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:46.662964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61fc10-3091-4f2b-b8e9-cd20fcb1edf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-0f61fc10-3091-4f2b-b8e9-cd20fcb1edf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:46.667874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:46.668789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:46.669883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 156/313] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:46.675173 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87b320-8225-4f9f-9090-3420c997ffa0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:46.749314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:46.782524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87b320-8225-4f9f-9090-3420c997ffa0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:46.816633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:46.817345 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:46.817619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:46.817886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:46.818547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:46.818840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:46.820219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:46.829054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 158/314] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:46.834750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61fc10-3091-4f2b-b8e9-cd20fcb1edf7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:46.863454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:46.937879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61fc10-3091-4f2b-b8e9-cd20fcb1edf7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:46.972208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707e4fa-d010-4ed8-85de-36a314ca3bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:46.973057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e4fa-d010-4ed8-85de-36a314ca3bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:46.973433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e4fa-d010-4ed8-85de-36a314ca3bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:46.973643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e4fa-d010-4ed8-85de-36a314ca3bc0 None admin] PATH_INFO: `/v3/users/bed7068037a3475b89486bc7fcdc46b1` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:46.974799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707e4fa-d010-4ed8-85de-36a314ca3bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=bed7068037a3475b89486bc7fcdc46b1)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:46.976247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707e4fa-d010-4ed8-85de-36a314ca3bc0 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:46.978183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 157/315] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:46 2022] GET /identity/v3/users/bed7068037a3475b89486bc7fcdc46b1 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:46.983595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:47.096488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2fb8-f0f5-4974-a775-69ee1e12888f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:47.131544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a541ca-08a6-493a-998d-9c2d4413865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:47.132447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a541ca-08a6-493a-998d-9c2d4413865d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:47.132447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a541ca-08a6-493a-998d-9c2d4413865d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:47.132697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a541ca-08a6-493a-998d-9c2d4413865d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:47.135610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:47.205645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a541ca-08a6-493a-998d-9c2d4413865d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:47.207380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a541ca-08a6-493a-998d-9c2d4413865d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:47.319369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 159/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:47.325639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707e4fa-d010-4ed8-85de-36a314ca3bc0 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:47.429876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:47.436135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707e4fa-d010-4ed8-85de-36a314ca3bc0 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:47.470978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab960a0-440e-42ad-8d85-c00cc09f2b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:47.471615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab960a0-440e-42ad-8d85-c00cc09f2b38 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:47.471889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab960a0-440e-42ad-8d85-c00cc09f2b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:47.472156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab960a0-440e-42ad-8d85-c00cc09f2b38 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:47.473493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab960a0-440e-42ad-8d85-c00cc09f2b38 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:47.474931 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab960a0-440e-42ad-8d85-c00cc09f2b38 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:47.476734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 158/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:47 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:47.482652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a541ca-08a6-493a-998d-9c2d4413865d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:47.518712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:47.591903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a541ca-08a6-493a-998d-9c2d4413865d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:47.627599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e81bf1-34a2-4ac1-a456-3197f1ab7ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:47.628569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81bf1-34a2-4ac1-a456-3197f1ab7ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:47.629126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81bf1-34a2-4ac1-a456-3197f1ab7ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:47.629586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81bf1-34a2-4ac1-a456-3197f1ab7ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:47.630574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e81bf1-34a2-4ac1-a456-3197f1ab7ec9 None admin] RBAC: Adding query filter params (role.id=48a551b7e05445ceb37de851862f0cc8, scope.project.id=1be4be6e21b140929ca372bd03dc82ab, user.id=bed7068037a3475b89486bc7fcdc46b1) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:47.631115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e81bf1-34a2-4ac1-a456-3197f1ab7ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:47.633338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e81bf1-34a2-4ac1-a456-3197f1ab7ec9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:47.640062 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 160/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:05:47 2022] GET /identity/v3/role_assignments?user.id=bed7068037a3475b89486bc7fcdc46b1&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=48a551b7e05445ceb37de851862f0cc8 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:48.028528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065b78-86e7-4682-baa1-1b44a2a33414 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.029072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065b78-86e7-4682-baa1-1b44a2a33414 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.029072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065b78-86e7-4682-baa1-1b44a2a33414 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.030482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 159/319] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:48.036024 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b254-a50e-4e96-aeed-a8b362e29e98 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.036446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b254-a50e-4e96-aeed-a8b362e29e98 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.036544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b254-a50e-4e96-aeed-a8b362e29e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.055355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e3c0b254-a50e-4e96-aeed-a8b362e29e98 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:48.056538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e3c0b254-a50e-4e96-aeed-a8b362e29e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:48.131217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 161/320] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:48.148144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e44c18-b107-4d66-b08b-7192f611d1b2 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.148399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e44c18-b107-4d66-b08b-7192f611d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.148873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e44c18-b107-4d66-b08b-7192f611d1b2 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.150240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 160/321] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:48.155541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135134f-6704-4470-bbad-6abcc21e0ef1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.155830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135134f-6704-4470-bbad-6abcc21e0ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.156100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135134f-6704-4470-bbad-6abcc21e0ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.174924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6135134f-6704-4470-bbad-6abcc21e0ef1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:48.176116 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6135134f-6704-4470-bbad-6abcc21e0ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:48.199763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:48.215448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688da7e4-95ce-42ac-a43f-955d27fa2e38 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.215696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688da7e4-95ce-42ac-a43f-955d27fa2e38 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.216193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688da7e4-95ce-42ac-a43f-955d27fa2e38 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.217520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 161/322] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:48.222315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0febd-7231-4b94-822b-a37ccb2d3b8e None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.222818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0febd-7231-4b94-822b-a37ccb2d3b8e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.223075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0febd-7231-4b94-822b-a37ccb2d3b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.240916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b7e0febd-7231-4b94-822b-a37ccb2d3b8e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:48.242332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b7e0febd-7231-4b94-822b-a37ccb2d3b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:48.249370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 162/323] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:48.309588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 162/324] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:48.396159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135134f-6704-4470-bbad-6abcc21e0ef1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:48.493510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135134f-6704-4470-bbad-6abcc21e0ef1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:48.527724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6bc8d-e4e2-4b42-8898-d038483e74ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:48.528357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6bc8d-e4e2-4b42-8898-d038483e74ed None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.528647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6bc8d-e4e2-4b42-8898-d038483e74ed None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.528920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6bc8d-e4e2-4b42-8898-d038483e74ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.539767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6bc8d-e4e2-4b42-8898-d038483e74ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:48.540690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0febd-7231-4b94-822b-a37ccb2d3b8e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9ae6bc8d-e4e2-4b42-8898-d038483e74ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:48.544547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:48.545657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:48.546513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:48.550546 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 163/325] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:48.551293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6bc8d-e4e2-4b42-8898-d038483e74ed None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:48.570480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:48.634220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:48.643497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0febd-7231-4b94-822b-a37ccb2d3b8e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:48.654314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6bc8d-e4e2-4b42-8898-d038483e74ed None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:48.677563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6122d9-4a64-47db-b842-e558268cd753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:48.678195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6122d9-4a64-47db-b842-e558268cd753 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.678468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6122d9-4a64-47db-b842-e558268cd753 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.678734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6122d9-4a64-47db-b842-e558268cd753 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.679805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6122d9-4a64-47db-b842-e558268cd753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:48.681296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6122d9-4a64-47db-b842-e558268cd753 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:48.682838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 163/326] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:05:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:48.683668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6122d9-4a64-47db-b842-e558268cd753 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:48.689693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:48.690305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.690579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.690844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.691847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:48.692169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:48.693799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:48.702000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 164/327] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:48.702760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:48.782784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:48.784019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6122d9-4a64-47db-b842-e558268cd753 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:48.802555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5f993-fbc0-48a3-a17d-ed8b15f666b8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:48.818207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350dd7d-6d9c-4d91-be31-4594ff8a355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:48.818846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350dd7d-6d9c-4d91-be31-4594ff8a355c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.819123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350dd7d-6d9c-4d91-be31-4594ff8a355c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.819389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350dd7d-6d9c-4d91-be31-4594ff8a355c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.829380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350dd7d-6d9c-4d91-be31-4594ff8a355c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-e350dd7d-6d9c-4d91-be31-4594ff8a355c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:48.834639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:48.835708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 164/328] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:48.836714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350dd7d-6d9c-4d91-be31-4594ff8a355c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:48.837926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45d015-eaf7-4b25-86b4-383fadc813be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:48.838512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45d015-eaf7-4b25-86b4-383fadc813be None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.838785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45d015-eaf7-4b25-86b4-383fadc813be None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.839049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45d015-eaf7-4b25-86b4-383fadc813be None admin] PATH_INFO: `/v3/groups` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.839673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45d015-eaf7-4b25-86b4-383fadc813be None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:48.841167 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45d015-eaf7-4b25-86b4-383fadc813be None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:48.858133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 165/329] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Aug 31 05:05:48 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:05:48.858950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45d015-eaf7-4b25-86b4-383fadc813be None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:48.871803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:48.945841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350dd7d-6d9c-4d91-be31-4594ff8a355c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:48.984485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a69cd-8ec7-4d93-abd1-87b8d4759fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:48.985152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a69cd-8ec7-4d93-abd1-87b8d4759fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:48.985429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a69cd-8ec7-4d93-abd1-87b8d4759fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:48.985694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a69cd-8ec7-4d93-abd1-87b8d4759fb0 None admin] PATH_INFO: `/v3/users/00008a492e4d4380a2e8f71d21a16d93` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:48.986097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45d015-eaf7-4b25-86b4-383fadc813be None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:48.986885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a69cd-8ec7-4d93-abd1-87b8d4759fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=00008a492e4d4380a2e8f71d21a16d93)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:48.988455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a69cd-8ec7-4d93-abd1-87b8d4759fb0 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:48.994910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 165/330] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:48 2022] GET /identity/v3/users/00008a492e4d4380a2e8f71d21a16d93 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:48.995943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a69cd-8ec7-4d93-abd1-87b8d4759fb0 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:49.026682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:49.027287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:49.027564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:49.027837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:49.028507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:49.028818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:49.030231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:49.039094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 166/331] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:49.046106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:49.048872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:49.099090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:49.118041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a69cd-8ec7-4d93-abd1-87b8d4759fb0 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:49.165730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aea59-b0d9-4734-a898-9df698cca135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:49.166664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aea59-b0d9-4734-a898-9df698cca135 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:49.167083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aea59-b0d9-4734-a898-9df698cca135 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:49.167546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aea59-b0d9-4734-a898-9df698cca135 None admin] PATH_INFO: `/v3/system/users/00008a492e4d4380a2e8f71d21a16d93/roles/48a551b7e05445ceb37de851862f0cc8` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:49.172313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205aea59-b0d9-4734-a898-9df698cca135 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=00008a492e4d4380a2e8f71d21a16d93, role_id=48a551b7e05445ceb37de851862f0cc8)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:49.175498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205aea59-b0d9-4734-a898-9df698cca135 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:49.183512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17349f9f-47be-42aa-982d-47d32a0af00e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:49.192431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 166/332] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Aug 31 05:05:48 2022] PUT /identity/v3/system/users/00008a492e4d4380a2e8f71d21a16d93/roles/48a551b7e05445ceb37de851862f0cc8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:05:49.228856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152c919-d9bd-49cd-893d-4cd08f757326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:49.229548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c919-d9bd-49cd-893d-4cd08f757326 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:49.229821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c919-d9bd-49cd-893d-4cd08f757326 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:49.230093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152c919-d9bd-49cd-893d-4cd08f757326 None admin] PATH_INFO: `/v3/users/94c692a306ed4c6895441580abf15ab9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:49.231661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152c919-d9bd-49cd-893d-4cd08f757326 None admin] RBAC: Authorizing `identity:get_user(user_id=94c692a306ed4c6895441580abf15ab9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:49.232755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152c919-d9bd-49cd-893d-4cd08f757326 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:49.234626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 167/333] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:49 2022] GET /identity/v3/users/94c692a306ed4c6895441580abf15ab9 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:49.240774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aea59-b0d9-4734-a898-9df698cca135 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:49.362909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aea59-b0d9-4734-a898-9df698cca135 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:49.404201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a62ed8-971e-4c4e-832c-ea5b78178399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:49.404819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62ed8-971e-4c4e-832c-ea5b78178399 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:49.405111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62ed8-971e-4c4e-832c-ea5b78178399 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:49.405392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a62ed8-971e-4c4e-832c-ea5b78178399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:49.406129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a62ed8-971e-4c4e-832c-ea5b78178399 None admin] RBAC: Adding query filter params (role.id=d2a6b97a907440368eca7f9387b778d6, user.id=94c692a306ed4c6895441580abf15ab9, scope.system=all) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:49.406433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a62ed8-971e-4c4e-832c-ea5b78178399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:49.407894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a62ed8-971e-4c4e-832c-ea5b78178399 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:49.421009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 167/334] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 31 05:05:49 2022] GET /identity/v3/role_assignments?user.id=94c692a306ed4c6895441580abf15ab9&scope.system=all&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:51.228553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2be447-14e5-411a-a1da-a87de6063e73 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:51.229069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2be447-14e5-411a-a1da-a87de6063e73 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:51.229192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2be447-14e5-411a-a1da-a87de6063e73 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:51.230946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 168/335] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:51.236114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6205-b25a-4673-8703-3a0da64d13f2 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:51.236534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6205-b25a-4673-8703-3a0da64d13f2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:51.236703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b6205-b25a-4673-8703-3a0da64d13f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:51.262262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8c9b6205-b25a-4673-8703-3a0da64d13f2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:51.263464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8c9b6205-b25a-4673-8703-3a0da64d13f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:51.266854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:51.313847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6d70-b69f-4526-86bc-e81d19bf0eeb None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:51.314178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6d70-b69f-4526-86bc-e81d19bf0eeb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:51.314386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6d70-b69f-4526-86bc-e81d19bf0eeb None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:51.315955 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 169/336] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:51.321035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24763-8beb-4298-8c63-f6ab220384bf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:51.321338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24763-8beb-4298-8c63-f6ab220384bf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:51.321607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24763-8beb-4298-8c63-f6ab220384bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:51.350448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0bc24763-8beb-4298-8c63-f6ab220384bf None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:51.351650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0bc24763-8beb-4298-8c63-f6ab220384bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:51.369556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 168/337] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:51.392844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c45ceb-6e1c-4517-b498-bb38d4e86c1b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:51.393210 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c45ceb-6e1c-4517-b498-bb38d4e86c1b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:51.393481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c45ceb-6e1c-4517-b498-bb38d4e86c1b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:51.395140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 169/338] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:51.400262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada968-c0c6-462e-9efb-8de2f70c8080 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:51.400536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada968-c0c6-462e-9efb-8de2f70c8080 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:51.400802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ada968-c0c6-462e-9efb-8de2f70c8080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:51.426757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f4ada968-c0c6-462e-9efb-8de2f70c8080 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:51.427967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f4ada968-c0c6-462e-9efb-8de2f70c8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:51.496621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:51.505453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 170/339] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:51.549345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 170/340] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:51.823870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc24763-8beb-4298-8c63-f6ab220384bf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:51.827813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ada968-c0c6-462e-9efb-8de2f70c8080 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:51.973467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:52.006332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ada968-c0c6-462e-9efb-8de2f70c8080 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:52.038957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc24763-8beb-4298-8c63-f6ab220384bf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:52.088121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c78511-7cbe-4568-8be3-318eb9775a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:52.088692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c78511-7cbe-4568-8be3-318eb9775a25 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.088970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c78511-7cbe-4568-8be3-318eb9775a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.089266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c78511-7cbe-4568-8be3-318eb9775a25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.101608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b12d0-5fcd-4844-b3b3-65899bdddf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:52.102310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b12d0-5fcd-4844-b3b3-65899bdddf92 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.102585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b12d0-5fcd-4844-b3b3-65899bdddf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.102851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b12d0-5fcd-4844-b3b3-65899bdddf92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.112833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c78511-7cbe-4568-8be3-318eb9775a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-01c78511-7cbe-4568-8be3-318eb9775a25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:52.117898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:52.120130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:52.122641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 171/341] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:52.130756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b12d0-5fcd-4844-b3b3-65899bdddf92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:52.131023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c78511-7cbe-4568-8be3-318eb9775a25 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-751b12d0-5fcd-4844-b3b3-65899bdddf92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:52.137382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:52.139453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 05:05:52.140711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:52.144639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 171/342] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:52.144639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b12d0-5fcd-4844-b3b3-65899bdddf92 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:52.271248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:52.333626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c78511-7cbe-4568-8be3-318eb9775a25 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:52.336151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b12d0-5fcd-4844-b3b3-65899bdddf92 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:52.379348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:52.384213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:52.384831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.385126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.385399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.386051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430906b8-83c7-41fa-b910-957a7bcf5952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:52.386180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:52.386363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:52.386785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430906b8-83c7-41fa-b910-957a7bcf5952 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.387170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430906b8-83c7-41fa-b910-957a7bcf5952 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.387499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430906b8-83c7-41fa-b910-957a7bcf5952 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.388100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:52.398808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 172/343] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:52.399891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430906b8-83c7-41fa-b910-957a7bcf5952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:52.400030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-430906b8-83c7-41fa-b910-957a7bcf5952 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:52.408061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:52.409241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:52.410354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:52.411127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 172/344] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:52.412980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ae0c-3104-47ab-9dd6-5ae9db0e9d5d None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.413297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ae0c-3104-47ab-9dd6-5ae9db0e9d5d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.413568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ae0c-3104-47ab-9dd6-5ae9db0e9d5d None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.418322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 173/345] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:52.419124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ae0c-3104-47ab-9dd6-5ae9db0e9d5d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:52.514941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807d86b-6a07-4402-aefb-3334c383d7d3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:52.537394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ae0c-3104-47ab-9dd6-5ae9db0e9d5d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:52.541282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:52.555375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:52.556004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.556281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.556550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.557293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:52.557602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:52.559005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:52.570820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 173/346] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:52.576864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:52.578644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052117-0bb0-4342-b21d-ff1306420cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:52.579331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052117-0bb0-4342-b21d-ff1306420cdc None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.579763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052117-0bb0-4342-b21d-ff1306420cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.580046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd052117-0bb0-4342-b21d-ff1306420cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.664948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd052117-0bb0-4342-b21d-ff1306420cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:52.665571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:52.669761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd052117-0bb0-4342-b21d-ff1306420cdc None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:52.694759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11ec5-23cc-4e88-be02-88d81b1780e2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:52.730669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe9a73-78b2-4404-9980-f45cfab16ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:52.731287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9a73-78b2-4404-9980-f45cfab16ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.731563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9a73-78b2-4404-9980-f45cfab16ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.731835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe9a73-78b2-4404-9980-f45cfab16ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.732501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9a73-78b2-4404-9980-f45cfab16ce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:52.732801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9a73-78b2-4404-9980-f45cfab16ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:52.734225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe9a73-78b2-4404-9980-f45cfab16ce6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:52.746051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 174/347] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:52.747573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ec72-6907-4e9e-a550-cc4cf9f32001 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.748148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ec72-6907-4e9e-a550-cc4cf9f32001 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.748756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ec72-6907-4e9e-a550-cc4cf9f32001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.768875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-75e2ec72-6907-4e9e-a550-cc4cf9f32001 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:52.771020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-75e2ec72-6907-4e9e-a550-cc4cf9f32001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:52.791502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 174/348] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:52.792689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052117-0bb0-4342-b21d-ff1306420cdc None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:52.821902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:52.852628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 175/349] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:52.857811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f1fa4-cd61-420d-86e5-c137fe6a1ca5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.858145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f1fa4-cd61-420d-86e5-c137fe6a1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.858435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f1fa4-cd61-420d-86e5-c137fe6a1ca5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.864394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 176/350] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:52.864394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f1fa4-cd61-420d-86e5-c137fe6a1ca5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:52.910922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:52.917682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd052117-0bb0-4342-b21d-ff1306420cdc None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:52.963400 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fe94f-2e24-4ea1-a745-76f1e84087bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:52.964212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fe94f-2e24-4ea1-a745-76f1e84087bc None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:52.965330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fe94f-2e24-4ea1-a745-76f1e84087bc None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:52.969479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fe94f-2e24-4ea1-a745-76f1e84087bc None admin] PATH_INFO: `/v3/users/00008a492e4d4380a2e8f71d21a16d93` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:52.971374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fe94f-2e24-4ea1-a745-76f1e84087bc None admin] RBAC: Authorizing `identity:get_user(user_id=00008a492e4d4380a2e8f71d21a16d93)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:52.973679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fe94f-2e24-4ea1-a745-76f1e84087bc None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:52.976154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 175/351] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:05:52 2022] GET /identity/v3/users/00008a492e4d4380a2e8f71d21a16d93 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:52.977297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fe94f-2e24-4ea1-a745-76f1e84087bc None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:53.003826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f1fa4-cd61-420d-86e5-c137fe6a1ca5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:53.058258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7a510-b9c7-4534-966e-14f901a149b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:53.059191 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7a510-b9c7-4534-966e-14f901a149b3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.059580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7a510-b9c7-4534-966e-14f901a149b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.060239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7a510-b9c7-4534-966e-14f901a149b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.098062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fe94f-2e24-4ea1-a745-76f1e84087bc None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:53.123875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:53.135656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d007de5-872a-4eb0-aeb3-6afba0745bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:53.136300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007de5-872a-4eb0-aeb3-6afba0745bce None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.136577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007de5-872a-4eb0-aeb3-6afba0745bce None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.136848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d007de5-872a-4eb0-aeb3-6afba0745bce None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.138000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d007de5-872a-4eb0-aeb3-6afba0745bce None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:53.139756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d007de5-872a-4eb0-aeb3-6afba0745bce None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:53.145265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 176/352] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:52 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:53.146488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a773b6-829e-42e8-925e-d6c7719432ec None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.146770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a773b6-829e-42e8-925e-d6c7719432ec None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.147039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a773b6-829e-42e8-925e-d6c7719432ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.154412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7a510-b9c7-4534-966e-14f901a149b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:53.156286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7a510-b9c7-4534-966e-14f901a149b3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:53.166517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d7a773b6-829e-42e8-925e-d6c7719432ec None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:53.167777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d7a773b6-829e-42e8-925e-d6c7719432ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:53.190109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:53.262835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 177/353] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:53.264333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a773b6-829e-42e8-925e-d6c7719432ec None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:53.283827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 177/354] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:53.290128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7a510-b9c7-4534-966e-14f901a149b3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:53.387668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:53.393746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a773b6-829e-42e8-925e-d6c7719432ec None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:53.420695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7a510-b9c7-4534-966e-14f901a149b3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:53.433153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:53.434126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.434545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.434956 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.435827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] RBAC: Adding query filter params (role.id=48a551b7e05445ceb37de851862f0cc8, user.id=00008a492e4d4380a2e8f71d21a16d93, scope.system=all) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:53.436275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:53.437894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:53.456612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 178/355] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Aug 31 05:05:53 2022] GET /identity/v3/role_assignments?user.id=00008a492e4d4380a2e8f71d21a16d93&scope.system=all&role.id=48a551b7e05445ceb37de851862f0cc8 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:53.460451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:53.462887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b68a2-0bf4-4c4d-993d-aa78da0d6193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:53.463618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b68a2-0bf4-4c4d-993d-aa78da0d6193 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.463965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b68a2-0bf4-4c4d-993d-aa78da0d6193 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.464301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b68a2-0bf4-4c4d-993d-aa78da0d6193 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.472227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b68a2-0bf4-4c4d-993d-aa78da0d6193 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:53.474597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b68a2-0bf4-4c4d-993d-aa78da0d6193 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:53.477212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 178/356] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:53 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:53.478013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b68a2-0bf4-4c4d-993d-aa78da0d6193 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:53.482833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:53.604057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca3aa7-3070-4efa-8a4a-5902f8bb8089 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:53.611749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b68a2-0bf4-4c4d-993d-aa78da0d6193 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:53.645943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ed69a-56b9-4188-898a-64920a6b650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:53.647303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed69a-56b9-4188-898a-64920a6b650d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.647303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed69a-56b9-4188-898a-64920a6b650d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.647303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ed69a-56b9-4188-898a-64920a6b650d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.660293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ed69a-56b9-4188-898a-64920a6b650d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:53.662872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce5784-ba4c-4870-bc6e-7e3971c41138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:53.663687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5784-ba4c-4870-bc6e-7e3971c41138 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.664107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5784-ba4c-4870-bc6e-7e3971c41138 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.664527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce5784-ba4c-4870-bc6e-7e3971c41138 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-6b3ed69a-56b9-4188-898a-64920a6b650d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:53.667142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:53.668209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 179/357] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:53.669214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22bcac-3be1-47a0-b32f-f72b94b696f9 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.670126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22bcac-3be1-47a0-b32f-f72b94b696f9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.670126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22bcac-3be1-47a0-b32f-f72b94b696f9 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.670277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 180/358] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:53.670991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22bcac-3be1-47a0-b32f-f72b94b696f9 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:53.671271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce5784-ba4c-4870-bc6e-7e3971c41138 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:53.672873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce5784-ba4c-4870-bc6e-7e3971c41138 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:53.676348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 179/359] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:53 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:53.677450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce5784-ba4c-4870-bc6e-7e3971c41138 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:53.691976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:53.774140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:53.794311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce5784-ba4c-4870-bc6e-7e3971c41138 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:53.805510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22bcac-3be1-47a0-b32f-f72b94b696f9 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:53.838989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc3f78-feea-49c1-819f-d5f7905e81a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:53.839647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3f78-feea-49c1-819f-d5f7905e81a1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.839946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3f78-feea-49c1-819f-d5f7905e81a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.840200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc3f78-feea-49c1-819f-d5f7905e81a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.843790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:53.844405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.844684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.844952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.847555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] RBAC: Adding query filter params (group.id=861225dba2d94bfda6bc52de7fc8bfa2, role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=01eefcc996554d09bd94843c0e1e6685) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:53.847555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:53.849397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:53.855966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc3f78-feea-49c1-819f-d5f7905e81a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:53.856983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 181/360] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:05:53 2022] GET /identity/v3/role_assignments?group.id=861225dba2d94bfda6bc52de7fc8bfa2&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:53.857865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3ddc3f78-feea-49c1-819f-d5f7905e81a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:53.862349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:53.869586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 180/361] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:53.870463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c529b-c93d-408f-80c4-7e8c7ca3dd9d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:53.871297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c529b-c93d-408f-80c4-7e8c7ca3dd9d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:53.871297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c529b-c93d-408f-80c4-7e8c7ca3dd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:53.898856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9d9c529b-c93d-408f-80c4-7e8c7ca3dd9d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:53.900263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9d9c529b-c93d-408f-80c4-7e8c7ca3dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:53.999409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:54.008094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 181/362] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:54.008767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c529b-c93d-408f-80c4-7e8c7ca3dd9d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:54.014996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d28b7-1518-46fc-9274-bc9b0e76fa1a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:54.059683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:54.060313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:54.060592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:54.060865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:54.062039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:54.062355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:54.064044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:54.071735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:54.077612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 182/363] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:54.078485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:54.149762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c529b-c93d-408f-80c4-7e8c7ca3dd9d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:54.196739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbddc6-23e8-4eb2-ab6c-6ff8c1a72604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:54.197431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbddc6-23e8-4eb2-ab6c-6ff8c1a72604 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:54.197715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbddc6-23e8-4eb2-ab6c-6ff8c1a72604 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:54.198000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbddc6-23e8-4eb2-ab6c-6ff8c1a72604 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:54.199147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbddc6-23e8-4eb2-ab6c-6ff8c1a72604 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:54.201216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbddc6-23e8-4eb2-ab6c-6ff8c1a72604 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:54.203281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 182/364] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:54 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:54.209689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbddc6-23e8-4eb2-ab6c-6ff8c1a72604 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:54.229598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de6a65-da81-485e-90de-0de26a162069 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:54.268814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:54.269458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:54.269739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:54.270067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:54.270746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:54.271098 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:54.272473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:54.282372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 183/365] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:54.283239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:54.299616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:54.344926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbddc6-23e8-4eb2-ab6c-6ff8c1a72604 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:54.358743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:54.384364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465e051-e69b-4ee0-8913-70172e0ff4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:54.384983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e051-e69b-4ee0-8913-70172e0ff4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:54.385321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e051-e69b-4ee0-8913-70172e0ff4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:54.385591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465e051-e69b-4ee0-8913-70172e0ff4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:54.407829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78687d2-f501-404e-98ee-6169fd18a334 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:54.458693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:54.459318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:54.459593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:54.459868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:54.460608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] RBAC: Adding query filter params (group.id=861225dba2d94bfda6bc52de7fc8bfa2, role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=01eefcc996554d09bd94843c0e1e6685) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:54.460915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:54.463352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:54.470142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 184/366] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:05:54 2022] GET /identity/v3/role_assignments?group.id=861225dba2d94bfda6bc52de7fc8bfa2&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:54.472719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:54.485681 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465e051-e69b-4ee0-8913-70172e0ff4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:54.488242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465e051-e69b-4ee0-8913-70172e0ff4c0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:54.594399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:54.616403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235ad08-53ba-4adf-a465-227c66223926 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:54.642489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 183/367] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:54.643475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465e051-e69b-4ee0-8913-70172e0ff4c0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:54.658160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:54.669726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fe042-c52e-4aad-ab63-d817739550b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:54.670351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fe042-c52e-4aad-ab63-d817739550b1 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:54.670680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fe042-c52e-4aad-ab63-d817739550b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:54.670957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fe042-c52e-4aad-ab63-d817739550b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:54.761345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fe042-c52e-4aad-ab63-d817739550b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:54.763509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fe042-c52e-4aad-ab63-d817739550b1 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:54.769039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465e051-e69b-4ee0-8913-70172e0ff4c0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:54.807296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63a27-02aa-4f72-a218-2150e251ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:54.807948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63a27-02aa-4f72-a218-2150e251ec15 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:54.808226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63a27-02aa-4f72-a218-2150e251ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:54.808503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d63a27-02aa-4f72-a218-2150e251ec15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:54.822813 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d63a27-02aa-4f72-a218-2150e251ec15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-59d63a27-02aa-4f72-a218-2150e251ec15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:54.829064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:54.830016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:54.830855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 184/368] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:54.831538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63a27-02aa-4f72-a218-2150e251ec15 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:54.864369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:54.900301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 185/369] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:54.901790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fe042-c52e-4aad-ab63-d817739550b1 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:54.939818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:54.966783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d63a27-02aa-4f72-a218-2150e251ec15 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.004941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c39449-2b42-472b-86fa-751190044203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.005849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39449-2b42-472b-86fa-751190044203 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.006296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39449-2b42-472b-86fa-751190044203 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.006855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39449-2b42-472b-86fa-751190044203 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.008265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c39449-2b42-472b-86fa-751190044203 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.009904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c39449-2b42-472b-86fa-751190044203 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.012229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 185/370] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:54 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:55.013193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c39449-2b42-472b-86fa-751190044203 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:55.028206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fe042-c52e-4aad-ab63-d817739550b1 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.079778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.080399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.080679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.080951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.082035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:55.083006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.084692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.099581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 186/371] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:55.101167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:55.149761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:55.159472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c39449-2b42-472b-86fa-751190044203 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.211608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ad73-9df0-4933-afc7-5b4fa26af230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.212421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ad73-9df0-4933-afc7-5b4fa26af230 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.212701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ad73-9df0-4933-afc7-5b4fa26af230 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.213830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17ad73-9df0-4933-afc7-5b4fa26af230 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.214984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17ad73-9df0-4933-afc7-5b4fa26af230 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.216433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17ad73-9df0-4933-afc7-5b4fa26af230 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.221051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 186/372] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:55 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:55.222280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ad73-9df0-4933-afc7-5b4fa26af230 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:55.239841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:55.264462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e62d23-4cf2-49bf-9f34-877d9fe36d45 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.314795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1764b-68ae-487e-9c30-ae64923f9008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.315452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1764b-68ae-487e-9c30-ae64923f9008 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.315732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1764b-68ae-487e-9c30-ae64923f9008 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.316293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1764b-68ae-487e-9c30-ae64923f9008 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.319902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1764b-68ae-487e-9c30-ae64923f9008 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.321534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1764b-68ae-487e-9c30-ae64923f9008 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.325235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 187/373] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:55 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:55.326110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1764b-68ae-487e-9c30-ae64923f9008 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:55.374805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17ad73-9df0-4933-afc7-5b4fa26af230 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.425129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292fafd-0e17-4178-a041-dfc1b064698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.426357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292fafd-0e17-4178-a041-dfc1b064698a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.426858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292fafd-0e17-4178-a041-dfc1b064698a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.427586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292fafd-0e17-4178-a041-dfc1b064698a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.463008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1764b-68ae-487e-9c30-ae64923f9008 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.470351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:55.504416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36370-3935-47bb-9063-c1f87cf60b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.506128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36370-3935-47bb-9063-c1f87cf60b58 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.506615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36370-3935-47bb-9063-c1f87cf60b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.507308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36370-3935-47bb-9063-c1f87cf60b58 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.508869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c36370-3935-47bb-9063-c1f87cf60b58 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.511026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c36370-3935-47bb-9063-c1f87cf60b58 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.513525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 188/374] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:55 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:55.514892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36370-3935-47bb-9063-c1f87cf60b58 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:55.524142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292fafd-0e17-4178-a041-dfc1b064698a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.526025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292fafd-0e17-4178-a041-dfc1b064698a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.548177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:55.649258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 187/375] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:05:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:05:55.650416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292fafd-0e17-4178-a041-dfc1b064698a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:55.655227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36370-3935-47bb-9063-c1f87cf60b58 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.699947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.701345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.701875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.702312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.703430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] RBAC: Adding query filter params (group.id=861225dba2d94bfda6bc52de7fc8bfa2, role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=1be4be6e21b140929ca372bd03dc82ab) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:55.703874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.706212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.713669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 189/376] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:05:55 2022] GET /identity/v3/role_assignments?group.id=861225dba2d94bfda6bc52de7fc8bfa2&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:55.714966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:55.721728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:55.773536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292fafd-0e17-4178-a041-dfc1b064698a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.820795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.821616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.821995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.822357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.823209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] RBAC: Adding query filter params (group.id=861225dba2d94bfda6bc52de7fc8bfa2, role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=1be4be6e21b140929ca372bd03dc82ab) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:55.823617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.825263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.835587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 188/377] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:05:55 2022] GET /identity/v3/role_assignments?group.id=861225dba2d94bfda6bc52de7fc8bfa2&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:55.844370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:55.859013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ce754-5e70-4275-9dec-44b47db792fe None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:55.900929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50023348-abe8-4742-80df-e5742c6b27d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:55.901869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50023348-abe8-4742-80df-e5742c6b27d5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:55.902322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50023348-abe8-4742-80df-e5742c6b27d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:55.902736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50023348-abe8-4742-80df-e5742c6b27d5 None admin] PATH_INFO: `/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:55.904095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50023348-abe8-4742-80df-e5742c6b27d5 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8c567a5ea14fdea15f5fb60bb768ec)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:55.905771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50023348-abe8-4742-80df-e5742c6b27d5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:55.907937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 190/378] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:55 2022] GET /identity/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:55.916042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:56.051767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31a749-2559-4be6-ab18-bdeb04d57e06 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:56.077853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:56.088140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69fcb7-e89b-48c6-b6f9-c7f2e9dea581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:56.088781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fcb7-e89b-48c6-b6f9-c7f2e9dea581 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:56.089053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fcb7-e89b-48c6-b6f9-c7f2e9dea581 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:56.089350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fcb7-e89b-48c6-b6f9-c7f2e9dea581 None admin] PATH_INFO: `/v3/groups/6444ac321dc14319a935dd7f843ff38f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:56.094462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69fcb7-e89b-48c6-b6f9-c7f2e9dea581 None admin] RBAC: Authorizing `identity:get_group(group_id=6444ac321dc14319a935dd7f843ff38f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:56.095918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69fcb7-e89b-48c6-b6f9-c7f2e9dea581 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:56.097990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 189/379] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:55 2022] GET /identity/v3/groups/6444ac321dc14319a935dd7f843ff38f => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:56.103957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50023348-abe8-4742-80df-e5742c6b27d5 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:56.109202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcebd8-4bb1-4583-8de3-e035e00f6727 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:56.109538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcebd8-4bb1-4583-8de3-e035e00f6727 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:56.109809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcebd8-4bb1-4583-8de3-e035e00f6727 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:56.111140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 190/380] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:56.118640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae328b0-7b8c-4c78-a303-be5ef3b55319 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:56.118996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae328b0-7b8c-4c78-a303-be5ef3b55319 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:56.119360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae328b0-7b8c-4c78-a303-be5ef3b55319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:56.138956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-aae328b0-7b8c-4c78-a303-be5ef3b55319 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:56.140552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aae328b0-7b8c-4c78-a303-be5ef3b55319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:56.263688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 191/381] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:56.300233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50023348-abe8-4742-80df-e5742c6b27d5 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:56.348017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148b18d-f025-456b-a2ad-44d22f5d053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:56.348812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b18d-f025-456b-a2ad-44d22f5d053a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:56.349108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b18d-f025-456b-a2ad-44d22f5d053a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:56.349435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b18d-f025-456b-a2ad-44d22f5d053a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:56.350175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148b18d-f025-456b-a2ad-44d22f5d053a None admin] RBAC: Adding query filter params (group.id=6444ac321dc14319a935dd7f843ff38f, role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=2e8c567a5ea14fdea15f5fb60bb768ec) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:56.350486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148b18d-f025-456b-a2ad-44d22f5d053a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:56.351919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148b18d-f025-456b-a2ad-44d22f5d053a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:56.358103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 191/382] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:05:56 2022] GET /identity/v3/role_assignments?group.id=6444ac321dc14319a935dd7f843ff38f&scope.project.id=2e8c567a5ea14fdea15f5fb60bb768ec&role.id=6da07502c09e4fc8afb31b58e434479b => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:56.654568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae328b0-7b8c-4c78-a303-be5ef3b55319 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:56.782954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae328b0-7b8c-4c78-a303-be5ef3b55319 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:56.791158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915e7a-aafe-4c87-87d2-39aedb0ed8ad None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:56.792021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915e7a-aafe-4c87-87d2-39aedb0ed8ad None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:56.792472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68915e7a-aafe-4c87-87d2-39aedb0ed8ad None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:56.794088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 192/383] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:05:56.799060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b262d-54b2-4737-9769-9822da57ea16 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:56.799342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b262d-54b2-4737-9769-9822da57ea16 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:56.799617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b262d-54b2-4737-9769-9822da57ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:56.812498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:56.823068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d09b262d-54b2-4737-9769-9822da57ea16 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:56.824288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d09b262d-54b2-4737-9769-9822da57ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:56.829290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe883e-261f-4470-9e3a-031e21f7933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:56.830170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe883e-261f-4470-9e3a-031e21f7933a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:56.830621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe883e-261f-4470-9e3a-031e21f7933a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:56.831073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe883e-261f-4470-9e3a-031e21f7933a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:56.841285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:56.855505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe883e-261f-4470-9e3a-031e21f7933a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7ebe883e-261f-4470-9e3a-031e21f7933a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:56.860656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:56.861604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:56.862417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:56.867168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 192/384] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:56.871722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe883e-261f-4470-9e3a-031e21f7933a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:56.938389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 193/385] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:05:57.013034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe883e-261f-4470-9e3a-031e21f7933a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:57.052800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:57.053461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:57.053743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:57.054010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:57.054690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:57.054995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:57.056378 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:57.065704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 193/386] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:57.071797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b262d-54b2-4737-9769-9822da57ea16 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:57.220447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b262d-54b2-4737-9769-9822da57ea16 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:57.265387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825753d-88d1-47a2-8a5a-97d7570e0e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:57.266025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825753d-88d1-47a2-8a5a-97d7570e0e2c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:57.266308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825753d-88d1-47a2-8a5a-97d7570e0e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:57.266573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825753d-88d1-47a2-8a5a-97d7570e0e2c None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:57.268829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825753d-88d1-47a2-8a5a-97d7570e0e2c None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:57.270644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825753d-88d1-47a2-8a5a-97d7570e0e2c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:57.272571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 194/387] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:57 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:57.278093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:57.320309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825753d-88d1-47a2-8a5a-97d7570e0e2c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:57.340979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:57.361466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:57.414405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1c8ba-117f-460d-861c-b1dfb89fdddc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:57.459667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809247e-8b00-48e1-80d0-fc22f559aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:57.460595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809247e-8b00-48e1-80d0-fc22f559aaab None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:57.461019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809247e-8b00-48e1-80d0-fc22f559aaab None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:57.461452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809247e-8b00-48e1-80d0-fc22f559aaab None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:57.465782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809247e-8b00-48e1-80d0-fc22f559aaab None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:57.467426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809247e-8b00-48e1-80d0-fc22f559aaab None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:57.469569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 194/388] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:57 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:57.475465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809247e-8b00-48e1-80d0-fc22f559aaab None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:57.503882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825753d-88d1-47a2-8a5a-97d7570e0e2c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:57.543548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49832e1a-3c3d-4fed-872a-e512224fbb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:57.544453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49832e1a-3c3d-4fed-872a-e512224fbb7d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:57.544869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49832e1a-3c3d-4fed-872a-e512224fbb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:57.545315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49832e1a-3c3d-4fed-872a-e512224fbb7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:57.555998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49832e1a-3c3d-4fed-872a-e512224fbb7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-49832e1a-3c3d-4fed-872a-e512224fbb7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:57.561190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:57.562275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:57.563276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:57.565599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 195/389] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:57.574101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49832e1a-3c3d-4fed-872a-e512224fbb7d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:57.622076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809247e-8b00-48e1-80d0-fc22f559aaab None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:57.647106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:57.670469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:57.690765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e965-074f-49f6-be98-79fce0eb1a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:57.691483 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e965-074f-49f6-be98-79fce0eb1a4d None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:57.691765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e965-074f-49f6-be98-79fce0eb1a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:57.692037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e965-074f-49f6-be98-79fce0eb1a4d None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685/groups/861225dba2d94bfda6bc52de7fc8bfa2/roles/3fa1cdc33cf343228f9d443a59102f22` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:57.692595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49832e1a-3c3d-4fed-872a-e512224fbb7d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:57.694364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e965-074f-49f6-be98-79fce0eb1a4d None admin] RBAC: Authorizing `identity:create_grant(project_id=01eefcc996554d09bd94843c0e1e6685, group_id=861225dba2d94bfda6bc52de7fc8bfa2, role_id=3fa1cdc33cf343228f9d443a59102f22)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:57.695934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e965-074f-49f6-be98-79fce0eb1a4d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:57.726321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 195/390] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 31 05:05:57 2022] PUT /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685/groups/861225dba2d94bfda6bc52de7fc8bfa2/roles/3fa1cdc33cf343228f9d443a59102f22 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:05:57.730822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:57.731543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:57.731821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:57.732130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:57.732857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:57.733222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:57.734774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:57.745097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 196/391] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:57.750793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e965-074f-49f6-be98-79fce0eb1a4d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:57.919391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e965-074f-49f6-be98-79fce0eb1a4d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:57.958635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c6807-1f5e-4635-9982-ff98c3e3cd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:57.959292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6807-1f5e-4635-9982-ff98c3e3cd55 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:57.959572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6807-1f5e-4635-9982-ff98c3e3cd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:57.959847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c6807-1f5e-4635-9982-ff98c3e3cd55 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:57.962313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c6807-1f5e-4635-9982-ff98c3e3cd55 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:57.963773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c6807-1f5e-4635-9982-ff98c3e3cd55 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:57.965743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 196/392] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:57 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:57.970980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:58.116261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6297-65be-4425-b2cd-fc6cd806a645 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:58.116908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6297-65be-4425-b2cd-fc6cd806a645 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:58.117407 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb6297-65be-4425-b2cd-fc6cd806a645 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:58.119312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 197/393] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:58.123137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8555aca-0310-4562-a7cf-13339e6f1e89 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:58.124716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4e5e-055d-4f40-bb07-e8597019bd42 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:58.125275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4e5e-055d-4f40-bb07-e8597019bd42 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:58.125750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4e5e-055d-4f40-bb07-e8597019bd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:58.158143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824aa439-1cc2-418b-a878-c953a27a010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:58.159023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa439-1cc2-418b-a878-c953a27a010d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:58.159545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa439-1cc2-418b-a878-c953a27a010d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:58.160142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa439-1cc2-418b-a878-c953a27a010d None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:58.161535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824aa439-1cc2-418b-a878-c953a27a010d None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:58.163208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824aa439-1cc2-418b-a878-c953a27a010d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:58.165458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 197/394] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:57 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:58.166114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d9cf4e5e-055d-4f40-bb07-e8597019bd42 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:58.173164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d9cf4e5e-055d-4f40-bb07-e8597019bd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:58.174260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824aa439-1cc2-418b-a878-c953a27a010d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:58.188505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:58.237363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:58.311345 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 198/395] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:58.332844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824aa439-1cc2-418b-a878-c953a27a010d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:58.373948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c48a25-c57d-4a08-98ca-bbe142a36e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:58.374529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48a25-c57d-4a08-98ca-bbe142a36e7d None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:58.374810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48a25-c57d-4a08-98ca-bbe142a36e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:58.375077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c48a25-c57d-4a08-98ca-bbe142a36e7d None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685/groups/861225dba2d94bfda6bc52de7fc8bfa2/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:58.377002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c48a25-c57d-4a08-98ca-bbe142a36e7d None admin] RBAC: Authorizing `identity:create_grant(project_id=01eefcc996554d09bd94843c0e1e6685, group_id=861225dba2d94bfda6bc52de7fc8bfa2, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:58.378500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c48a25-c57d-4a08-98ca-bbe142a36e7d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:58.399446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 198/396] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 31 05:05:58 2022] PUT /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685/groups/861225dba2d94bfda6bc52de7fc8bfa2/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:58.458580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b52dc-ce8a-4422-a39b-1da45c3abda1 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:58.458961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b52dc-ce8a-4422-a39b-1da45c3abda1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:58.459127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b52dc-ce8a-4422-a39b-1da45c3abda1 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:58.460782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 199/397] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:58.466627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c996e8-d748-4e0d-90ec-f5e59e5749d0 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:58.466915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c996e8-d748-4e0d-90ec-f5e59e5749d0 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:58.467190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c996e8-d748-4e0d-90ec-f5e59e5749d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:58.490137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-64c996e8-d748-4e0d-90ec-f5e59e5749d0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:58.491358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-64c996e8-d748-4e0d-90ec-f5e59e5749d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:58.559153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:58.566311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 199/398] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:58.739495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b52dc-ce8a-4422-a39b-1da45c3abda1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:58.878304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b52dc-ce8a-4422-a39b-1da45c3abda1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:58.907155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c996e8-d748-4e0d-90ec-f5e59e5749d0 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:58.915060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709378e-8cb9-4f23-bf77-c39208c70fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:58.915787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709378e-8cb9-4f23-bf77-c39208c70fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:58.916070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709378e-8cb9-4f23-bf77-c39208c70fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:58.916389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709378e-8cb9-4f23-bf77-c39208c70fa3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:58.927708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709378e-8cb9-4f23-bf77-c39208c70fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e709378e-8cb9-4f23-bf77-c39208c70fa3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:58.932693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:58.933641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:58.934930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 200/399] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:05:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:05:58.941652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709378e-8cb9-4f23-bf77-c39208c70fa3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:58.993489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:59.080406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709378e-8cb9-4f23-bf77-c39208c70fa3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:59.094760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c996e8-d748-4e0d-90ec-f5e59e5749d0 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:59.118117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00855d47-ac1a-4989-99b3-32c1b3571250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:59.118738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00855d47-ac1a-4989-99b3-32c1b3571250 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.119080 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00855d47-ac1a-4989-99b3-32c1b3571250 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.119359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00855d47-ac1a-4989-99b3-32c1b3571250 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.120089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00855d47-ac1a-4989-99b3-32c1b3571250 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:59.120397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00855d47-ac1a-4989-99b3-32c1b3571250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:59.121874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00855d47-ac1a-4989-99b3-32c1b3571250 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:59.131027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 201/400] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:05:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:59.132130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b337081-5ec0-473d-98cb-78524148d5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:59.132330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8799a8-9806-428f-b86c-4570b89603f6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.132577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8799a8-9806-428f-b86c-4570b89603f6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.132770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337081-5ec0-473d-98cb-78524148d5eb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.132893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8799a8-9806-428f-b86c-4570b89603f6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.133061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337081-5ec0-473d-98cb-78524148d5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.133339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b337081-5ec0-473d-98cb-78524148d5eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.134334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 202/401] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:05:59.139900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8799a8-9806-428f-b86c-4570b89603f6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:59.146041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b337081-5ec0-473d-98cb-78524148d5eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-4b337081-5ec0-473d-98cb-78524148d5eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:59.151077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:59.152028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:05:59.153263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 200/402] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:59.153930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4793cc-0826-450d-8fcd-a38ba9c516ec None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.153930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4793cc-0826-450d-8fcd-a38ba9c516ec None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.153930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4793cc-0826-450d-8fcd-a38ba9c516ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.172769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8a4793cc-0826-450d-8fcd-a38ba9c516ec None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:05:59.173922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8a4793cc-0826-450d-8fcd-a38ba9c516ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:05:59.232871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:59.257121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 201/403] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:05:59.257121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4793cc-0826-450d-8fcd-a38ba9c516ec None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:59.268083 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:59.293781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8799a8-9806-428f-b86c-4570b89603f6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:59.357861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716e4a-ee1f-47af-82e4-97e89c257250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:59.358799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716e4a-ee1f-47af-82e4-97e89c257250 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.359240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716e4a-ee1f-47af-82e4-97e89c257250 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.359660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716e4a-ee1f-47af-82e4-97e89c257250 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.360982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716e4a-ee1f-47af-82e4-97e89c257250 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:59.361984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4793cc-0826-450d-8fcd-a38ba9c516ec None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:59.362783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716e4a-ee1f-47af-82e4-97e89c257250 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:59.365211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 203/404] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:59 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:59.370500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716e4a-ee1f-47af-82e4-97e89c257250 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:59.434645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:59.435184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.435466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.435734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.436409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] RBAC: Adding query filter params (name=member) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:05:59.436712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:59.438121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:59.460904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 202/405] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:05:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:05:59.467068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:59.564239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716e4a-ee1f-47af-82e4-97e89c257250 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:59.566106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:59.635754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182adc-d23c-4bf2-bae0-f87fa5d690c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:59.636687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182adc-d23c-4bf2-bae0-f87fa5d690c6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.637251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182adc-d23c-4bf2-bae0-f87fa5d690c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.637737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182adc-d23c-4bf2-bae0-f87fa5d690c6 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.639903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182adc-d23c-4bf2-bae0-f87fa5d690c6 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:59.642051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182adc-d23c-4bf2-bae0-f87fa5d690c6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:59.645756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 204/406] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:59 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:59.646705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182adc-d23c-4bf2-bae0-f87fa5d690c6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:59.658342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec9f35-4628-41ac-9603-5ecadc801570 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:59.684457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:59.699076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08c5a-43a1-4cd2-8007-260e0f1025cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:59.699943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08c5a-43a1-4cd2-8007-260e0f1025cb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.700413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08c5a-43a1-4cd2-8007-260e0f1025cb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.700832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08c5a-43a1-4cd2-8007-260e0f1025cb None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.702634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e08c5a-43a1-4cd2-8007-260e0f1025cb None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:59.704588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e08c5a-43a1-4cd2-8007-260e0f1025cb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:59.711622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 203/407] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:05:59 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:05:59.711622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08c5a-43a1-4cd2-8007-260e0f1025cb None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:59.790122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182adc-d23c-4bf2-bae0-f87fa5d690c6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:59.835846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584893ac-7415-4a81-962d-42d5984e627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:59.836701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584893ac-7415-4a81-962d-42d5984e627c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.836980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584893ac-7415-4a81-962d-42d5984e627c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.837282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584893ac-7415-4a81-962d-42d5984e627c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.838905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08c5a-43a1-4cd2-8007-260e0f1025cb None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:05:59.850443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584893ac-7415-4a81-962d-42d5984e627c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-584893ac-7415-4a81-962d-42d5984e627c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:05:59.857999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:05:59.858969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:05:59.859844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:05:59.864882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 205/408] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:05:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:05:59.866262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:05:59.866451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584893ac-7415-4a81-962d-42d5984e627c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:05:59.887578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fda887-39ab-4f45-885e-dfa4a8e7ba58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:05:59.888754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fda887-39ab-4f45-885e-dfa4a8e7ba58 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:05:59.889947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fda887-39ab-4f45-885e-dfa4a8e7ba58 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:05:59.890571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fda887-39ab-4f45-885e-dfa4a8e7ba58 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab/groups/861225dba2d94bfda6bc52de7fc8bfa2/roles/3fa1cdc33cf343228f9d443a59102f22` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:05:59.893500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fda887-39ab-4f45-885e-dfa4a8e7ba58 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be4be6e21b140929ca372bd03dc82ab, group_id=861225dba2d94bfda6bc52de7fc8bfa2, role_id=3fa1cdc33cf343228f9d443a59102f22)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:05:59.895180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fda887-39ab-4f45-885e-dfa4a8e7ba58 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:05:59.921109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 204/409] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 31 05:05:59 2022] PUT /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab/groups/861225dba2d94bfda6bc52de7fc8bfa2/roles/3fa1cdc33cf343228f9d443a59102f22 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:05:59.921109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fda887-39ab-4f45-885e-dfa4a8e7ba58 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:00.003206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:00.027367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584893ac-7415-4a81-962d-42d5984e627c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:00.043885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fda887-39ab-4f45-885e-dfa4a8e7ba58 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:00.081682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155e03d-8967-4d29-87c1-77c67b0a121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:00.082770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155e03d-8967-4d29-87c1-77c67b0a121a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.083263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155e03d-8967-4d29-87c1-77c67b0a121a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.083733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155e03d-8967-4d29-87c1-77c67b0a121a None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.085061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155e03d-8967-4d29-87c1-77c67b0a121a None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:00.086771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155e03d-8967-4d29-87c1-77c67b0a121a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:00.092295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744c0e-805b-4705-9cec-5b846ee90006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:00.092922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744c0e-805b-4705-9cec-5b846ee90006 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.093266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744c0e-805b-4705-9cec-5b846ee90006 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.093376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 206/410] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:05:59 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:00.093538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744c0e-805b-4705-9cec-5b846ee90006 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.094221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744c0e-805b-4705-9cec-5b846ee90006 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:00.094525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744c0e-805b-4705-9cec-5b846ee90006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:00.094625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c5495-ffa0-4211-b30c-b91a465d3fca None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.094876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c5495-ffa0-4211-b30c-b91a465d3fca None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.095150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c5495-ffa0-4211-b30c-b91a465d3fca None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.095930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744c0e-805b-4705-9cec-5b846ee90006 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:00.096662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 207/411] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:00.098124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c5495-ffa0-4211-b30c-b91a465d3fca None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:00.110095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 205/412] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:05:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:00.111507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb59c4-56ce-4cac-973e-f489717fe16a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.111792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb59c4-56ce-4cac-973e-f489717fe16a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.112065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb59c4-56ce-4cac-973e-f489717fe16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.133167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-53bb59c4-56ce-4cac-973e-f489717fe16a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:00.134932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-53bb59c4-56ce-4cac-973e-f489717fe16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:00.177509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:00.223937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 206/413] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:00.223937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb59c4-56ce-4cac-973e-f489717fe16a None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:00.226805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c5495-ffa0-4211-b30c-b91a465d3fca None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:00.289630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db394792-6ff1-4bfb-8c5c-4a4898257e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:00.292078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394792-6ff1-4bfb-8c5c-4a4898257e74 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.292359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394792-6ff1-4bfb-8c5c-4a4898257e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.292635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394792-6ff1-4bfb-8c5c-4a4898257e74 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab/groups/861225dba2d94bfda6bc52de7fc8bfa2/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.296566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db394792-6ff1-4bfb-8c5c-4a4898257e74 None admin] RBAC: Authorizing `identity:create_grant(project_id=1be4be6e21b140929ca372bd03dc82ab, group_id=861225dba2d94bfda6bc52de7fc8bfa2, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:00.299504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db394792-6ff1-4bfb-8c5c-4a4898257e74 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:00.330182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 208/414] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 31 05:06:00 2022] PUT /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab/groups/861225dba2d94bfda6bc52de7fc8bfa2/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:06:00.381151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb59c4-56ce-4cac-973e-f489717fe16a None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:00.426761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aad09-76c0-4cf6-96d9-cad4c0a8eb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:00.427434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aad09-76c0-4cf6-96d9-cad4c0a8eb31 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.427710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aad09-76c0-4cf6-96d9-cad4c0a8eb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.428042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aad09-76c0-4cf6-96d9-cad4c0a8eb31 None admin] PATH_INFO: `/v3/groups/6444ac321dc14319a935dd7f843ff38f` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.429299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aad09-76c0-4cf6-96d9-cad4c0a8eb31 None admin] RBAC: Authorizing `identity:get_group(group_id=6444ac321dc14319a935dd7f843ff38f)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:00.431028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aad09-76c0-4cf6-96d9-cad4c0a8eb31 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:00.433160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 207/415] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:06:00 2022] GET /identity/v3/groups/6444ac321dc14319a935dd7f843ff38f => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:00.438798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db394792-6ff1-4bfb-8c5c-4a4898257e74 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:00.462877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:00.558978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aad09-76c0-4cf6-96d9-cad4c0a8eb31 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:00.565294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db394792-6ff1-4bfb-8c5c-4a4898257e74 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:00.601539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c4c25-9728-4207-8542-c74aa5de4f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:00.601539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c4c25-9728-4207-8542-c74aa5de4f4c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.601839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c4c25-9728-4207-8542-c74aa5de4f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.602088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c4c25-9728-4207-8542-c74aa5de4f4c None admin] PATH_INFO: `/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.602926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:00.603214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c4c25-9728-4207-8542-c74aa5de4f4c None admin] RBAC: Authorizing `identity:get_project(project_id=2e8c567a5ea14fdea15f5fb60bb768ec)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:00.604673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c4c25-9728-4207-8542-c74aa5de4f4c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:00.606702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 209/416] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:06:00 2022] GET /identity/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:00.613472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c4c25-9728-4207-8542-c74aa5de4f4c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:00.674218 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aad09-76c0-4cf6-96d9-cad4c0a8eb31 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:00.711192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5aa02f-0c6a-4f99-b388-10a670a49857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:00.711836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa02f-0c6a-4f99-b388-10a670a49857 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.712114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa02f-0c6a-4f99-b388-10a670a49857 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.712384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa02f-0c6a-4f99-b388-10a670a49857 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.723482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5aa02f-0c6a-4f99-b388-10a670a49857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-2d5aa02f-0c6a-4f99-b388-10a670a49857 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:00.728326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:00.729283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:00.730095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 208/417] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:00.731247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d56a7-048b-42bf-8b90-a8f96d5fe06b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.731247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d56a7-048b-42bf-8b90-a8f96d5fe06b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.731487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d56a7-048b-42bf-8b90-a8f96d5fe06b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.734040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:00.737537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 209/418] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:00.738894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d56a7-048b-42bf-8b90-a8f96d5fe06b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:00.740431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c4c25-9728-4207-8542-c74aa5de4f4c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:00.790889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b55121-904c-44ef-a4f0-2a356479c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:00.791610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55121-904c-44ef-a4f0-2a356479c453 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.792240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55121-904c-44ef-a4f0-2a356479c453 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.792584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b55121-904c-44ef-a4f0-2a356479c453 None admin] PATH_INFO: `/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec/groups/6444ac321dc14319a935dd7f843ff38f/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.795050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b55121-904c-44ef-a4f0-2a356479c453 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e8c567a5ea14fdea15f5fb60bb768ec, group_id=6444ac321dc14319a935dd7f843ff38f, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:00.797472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b55121-904c-44ef-a4f0-2a356479c453 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:00.817378 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 210/419] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Aug 31 05:06:00 2022] PUT /identity/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec/groups/6444ac321dc14319a935dd7f843ff38f/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:06:00.818897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404b52-756b-42b7-b354-a2b324bb0fee None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.819291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404b52-756b-42b7-b354-a2b324bb0fee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.820217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94404b52-756b-42b7-b354-a2b324bb0fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.850084 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:00.855882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d56a7-048b-42bf-8b90-a8f96d5fe06b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:00.860606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-94404b52-756b-42b7-b354-a2b324bb0fee None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:00.861934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-94404b52-756b-42b7-b354-a2b324bb0fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:00.913620 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:00.914371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:00.914653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:00.914923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:00.915719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:00.916080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:00.917514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:00.932926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 210/420] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:00.939501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:00.950241 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 211/421] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:01.082201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c797d1b-6131-4b0c-9631-1b4f4af4ce6a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:01.122661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977847d4-f59b-4e8e-998f-248cdfd814be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:01.123390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977847d4-f59b-4e8e-998f-248cdfd814be None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:01.123569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977847d4-f59b-4e8e-998f-248cdfd814be None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:01.123799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977847d4-f59b-4e8e-998f-248cdfd814be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:01.163185 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:01.201435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977847d4-f59b-4e8e-998f-248cdfd814be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:01.202890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977847d4-f59b-4e8e-998f-248cdfd814be None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:01.231330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404b52-756b-42b7-b354-a2b324bb0fee None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:01.324165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:01.356380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 211/422] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:01.362109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977847d4-f59b-4e8e-998f-248cdfd814be None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:01.383135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94404b52-756b-42b7-b354-a2b324bb0fee None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:01.447044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2955e6c-80aa-4550-8e67-f7a59beaf089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:01.447703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955e6c-80aa-4550-8e67-f7a59beaf089 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:01.447986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955e6c-80aa-4550-8e67-f7a59beaf089 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:01.448263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2955e6c-80aa-4550-8e67-f7a59beaf089 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:01.453448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:01.471428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2955e6c-80aa-4550-8e67-f7a59beaf089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e2955e6c-80aa-4550-8e67-f7a59beaf089 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:01.476650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:01.477611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:06:01.478424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:01.480743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 212/423] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:01.491485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2955e6c-80aa-4550-8e67-f7a59beaf089 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:01.523378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977847d4-f59b-4e8e-998f-248cdfd814be None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:01.601572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2955e6c-80aa-4550-8e67-f7a59beaf089 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:01.601795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cadf7-a91c-4130-82e4-f10147508a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:01.603522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cadf7-a91c-4130-82e4-f10147508a97 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:01.603893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cadf7-a91c-4130-82e4-f10147508a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:01.604067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cadf7-a91c-4130-82e4-f10147508a97 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:01.605844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cadf7-a91c-4130-82e4-f10147508a97 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:01.606774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cadf7-a91c-4130-82e4-f10147508a97 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:01.608364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 212/424] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:06:01 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:01.614361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cadf7-a91c-4130-82e4-f10147508a97 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:01.660274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:01.667216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:01.668181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:01.668691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:01.669169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:01.670222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:01.670714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:01.672604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:01.682890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 213/425] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:06:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:01.692780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:01.834527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cadf7-a91c-4130-82e4-f10147508a97 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:01.839232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c83530-37fd-4d00-b370-2034b92a4625 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:01.889839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:01.896587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695d74d-be3a-4bdb-8009-8dc394fd6f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:01.897261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695d74d-be3a-4bdb-8009-8dc394fd6f40 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:01.897542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695d74d-be3a-4bdb-8009-8dc394fd6f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:01.897814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695d74d-be3a-4bdb-8009-8dc394fd6f40 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:01.899187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695d74d-be3a-4bdb-8009-8dc394fd6f40 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:01.901539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ef15f-9fb9-4895-a6c2-fc9a120e7634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:01.902159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ef15f-9fb9-4895-a6c2-fc9a120e7634 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:01.902480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ef15f-9fb9-4895-a6c2-fc9a120e7634 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:01.902759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ef15f-9fb9-4895-a6c2-fc9a120e7634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:01.903601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695d74d-be3a-4bdb-8009-8dc394fd6f40 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:01.907505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 213/426] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:06:01 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:01.915163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695d74d-be3a-4bdb-8009-8dc394fd6f40 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:02.028746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:02.042142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ef15f-9fb9-4895-a6c2-fc9a120e7634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:02.043892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ef15f-9fb9-4895-a6c2-fc9a120e7634 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:02.067212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695d74d-be3a-4bdb-8009-8dc394fd6f40 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:02.102174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bceba0-68f2-4992-a156-d42fadda30d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:02.102838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bceba0-68f2-4992-a156-d42fadda30d5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.103119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bceba0-68f2-4992-a156-d42fadda30d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.103394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bceba0-68f2-4992-a156-d42fadda30d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.104127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bceba0-68f2-4992-a156-d42fadda30d5 None admin] RBAC: Adding query filter params (group.id=861225dba2d94bfda6bc52de7fc8bfa2, role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=01eefcc996554d09bd94843c0e1e6685) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:02.104433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bceba0-68f2-4992-a156-d42fadda30d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:02.105965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bceba0-68f2-4992-a156-d42fadda30d5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:02.112190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 214/427] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:06:01 2022] GET /identity/v3/role_assignments?group.id=861225dba2d94bfda6bc52de7fc8bfa2&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:02.113520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99b96-7311-49b7-badc-9a218d0ed48f None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.113809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99b96-7311-49b7-badc-9a218d0ed48f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.114087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99b96-7311-49b7-badc-9a218d0ed48f None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.115736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 215/428] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:02.121255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5894-2dc7-4cd0-bbfc-8f4e4824a84f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.121743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5894-2dc7-4cd0-bbfc-8f4e4824a84f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.122158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5894-2dc7-4cd0-bbfc-8f4e4824a84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.141999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4eee5894-2dc7-4cd0-bbfc-8f4e4824a84f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:02.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4eee5894-2dc7-4cd0-bbfc-8f4e4824a84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:02.190190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 214/429] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:02.201781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ef15f-9fb9-4895-a6c2-fc9a120e7634 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:02.219484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:02.242392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 216/430] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:06:02.324565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:02.333564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ef15f-9fb9-4895-a6c2-fc9a120e7634 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:02.373451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044255b-8068-4cb1-9182-9fdbe5e2e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:02.374101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044255b-8068-4cb1-9182-9fdbe5e2e2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.374428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044255b-8068-4cb1-9182-9fdbe5e2e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.374695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044255b-8068-4cb1-9182-9fdbe5e2e2f0 None admin] PATH_INFO: `/v3/projects/01eefcc996554d09bd94843c0e1e6685` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.375843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044255b-8068-4cb1-9182-9fdbe5e2e2f0 None admin] RBAC: Authorizing `identity:get_project(project_id=01eefcc996554d09bd94843c0e1e6685)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:02.377326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044255b-8068-4cb1-9182-9fdbe5e2e2f0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:02.384357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 215/431] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:06:02 2022] GET /identity/v3/projects/01eefcc996554d09bd94843c0e1e6685 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:02.385800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5894-2dc7-4cd0-bbfc-8f4e4824a84f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:02.490826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5894-2dc7-4cd0-bbfc-8f4e4824a84f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:02.527566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14047c-0ff8-45b2-b1a3-a67a34f03bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:02.528205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14047c-0ff8-45b2-b1a3-a67a34f03bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.528480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14047c-0ff8-45b2-b1a3-a67a34f03bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.528750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14047c-0ff8-45b2-b1a3-a67a34f03bf6 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.529918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14047c-0ff8-45b2-b1a3-a67a34f03bf6 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:02.531336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14047c-0ff8-45b2-b1a3-a67a34f03bf6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:02.537214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 217/432] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:06:02 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:02.539484 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044255b-8068-4cb1-9182-9fdbe5e2e2f0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:02.607376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14047c-0ff8-45b2-b1a3-a67a34f03bf6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:02.657259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044255b-8068-4cb1-9182-9fdbe5e2e2f0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:02.686414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:02.697906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9925dcf-7a48-4bbe-9e39-3fb71fdb2a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:02.698929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925dcf-7a48-4bbe-9e39-3fb71fdb2a28 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.699438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925dcf-7a48-4bbe-9e39-3fb71fdb2a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.699894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9925dcf-7a48-4bbe-9e39-3fb71fdb2a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.700821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9925dcf-7a48-4bbe-9e39-3fb71fdb2a28 None admin] RBAC: Adding query filter params (group.id=861225dba2d94bfda6bc52de7fc8bfa2, role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=01eefcc996554d09bd94843c0e1e6685) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:02.701348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9925dcf-7a48-4bbe-9e39-3fb71fdb2a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:02.702972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9925dcf-7a48-4bbe-9e39-3fb71fdb2a28 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:02.710302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 216/433] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:06:02 2022] GET /identity/v3/role_assignments?group.id=861225dba2d94bfda6bc52de7fc8bfa2&scope.project.id=01eefcc996554d09bd94843c0e1e6685&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:02.738142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14047c-0ff8-45b2-b1a3-a67a34f03bf6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:02.761471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890750ce-ab64-4cba-b9c5-b7e2c0e809b8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.761718 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890750ce-ab64-4cba-b9c5-b7e2c0e809b8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.762108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890750ce-ab64-4cba-b9c5-b7e2c0e809b8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.763786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 217/434] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:06:02.769870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e278-d0e2-47ff-a54a-07758031f6f5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.770251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e278-d0e2-47ff-a54a-07758031f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.770458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e278-d0e2-47ff-a54a-07758031f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.783092 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150cbce-9dc8-40c0-b2f9-3a46a34c6b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:02.784206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150cbce-9dc8-40c0-b2f9-3a46a34c6b3d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.785419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150cbce-9dc8-40c0-b2f9-3a46a34c6b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.785670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150cbce-9dc8-40c0-b2f9-3a46a34c6b3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.794504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c0a8e278-d0e2-47ff-a54a-07758031f6f5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:02.796415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c0a8e278-d0e2-47ff-a54a-07758031f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:02.803092 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150cbce-9dc8-40c0-b2f9-3a46a34c6b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-6150cbce-9dc8-40c0-b2f9-3a46a34c6b3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:02.808155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:02.809160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:06:02.809966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:02.814405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 218/435] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:02.815546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150cbce-9dc8-40c0-b2f9-3a46a34c6b3d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:02.827643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:02.883754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 218/436] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:02.941525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150cbce-9dc8-40c0-b2f9-3a46a34c6b3d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:02.959589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:02.978134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:02.978742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:02.978995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:02.979279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:02.979943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:02.980239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:02.981608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:02.990009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 219/437] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:02.995535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e278-d0e2-47ff-a54a-07758031f6f5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.100403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e278-d0e2-47ff-a54a-07758031f6f5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:03.136221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7306-658d-454f-912d-53d171376330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:03.136842 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7306-658d-454f-912d-53d171376330 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.137138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7306-658d-454f-912d-53d171376330 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.137409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7306-658d-454f-912d-53d171376330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.161742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.169262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:03.224301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7306-658d-454f-912d-53d171376330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:03.225831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7306-658d-454f-912d-53d171376330 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:03.275886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd982026-479b-4fc1-86d0-62cb99c8fbbe None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:03.317616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa811cee-4813-4ecf-8ffb-a1fa76fb1e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:03.318251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa811cee-4813-4ecf-8ffb-a1fa76fb1e97 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.318527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa811cee-4813-4ecf-8ffb-a1fa76fb1e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.318792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa811cee-4813-4ecf-8ffb-a1fa76fb1e97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.330613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa811cee-4813-4ecf-8ffb-a1fa76fb1e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-fa811cee-4813-4ecf-8ffb-a1fa76fb1e97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:03.335206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:03.336119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:03.337368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 220/438] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:03.338039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b17a0-6b4f-45fe-bdbf-8f85483060cc None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.338114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b17a0-6b4f-45fe-bdbf-8f85483060cc None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.338496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 219/439] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:03.338600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b17a0-6b4f-45fe-bdbf-8f85483060cc None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.339893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 221/440] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:03.344050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7306-658d-454f-912d-53d171376330 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.346031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b17a0-6b4f-45fe-bdbf-8f85483060cc None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.389905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:03.402217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:03.451966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7306-658d-454f-912d-53d171376330 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:03.458323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b17a0-6b4f-45fe-bdbf-8f85483060cc None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:03.486931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:03.487542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.487821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.488184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.488930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:03.489273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:03.490671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:03.492234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9218c-173d-4bee-bc0a-3ac88aec332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:03.492859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9218c-173d-4bee-bc0a-3ac88aec332b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.493163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9218c-173d-4bee-bc0a-3ac88aec332b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.493434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9218c-173d-4bee-bc0a-3ac88aec332b None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.494538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9218c-173d-4bee-bc0a-3ac88aec332b None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:03.495947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9218c-173d-4bee-bc0a-3ac88aec332b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:03.497603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 222/441] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:06:03 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:03.498769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ab444-a694-45d6-b5ca-b94e77179f15 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.499043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ab444-a694-45d6-b5ca-b94e77179f15 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.499310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ab444-a694-45d6-b5ca-b94e77179f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.502314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 220/442] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:06:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:03.503178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.520434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-216ab444-a694-45d6-b5ca-b94e77179f15 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:03.521665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-216ab444-a694-45d6-b5ca-b94e77179f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:03.589144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 223/443] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:03.590206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ab444-a694-45d6-b5ca-b94e77179f15 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.610574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916895-9c45-4cc8-8fc9-c56e34d99ff0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:03.638263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:03.641656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:03.660533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906542-dc53-4e84-ae57-6c091853d877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:03.661115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906542-dc53-4e84-ae57-6c091853d877 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.661402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906542-dc53-4e84-ae57-6c091853d877 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.661672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b906542-dc53-4e84-ae57-6c091853d877 None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.662792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b906542-dc53-4e84-ae57-6c091853d877 None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:03.664221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b906542-dc53-4e84-ae57-6c091853d877 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:03.665813 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 221/444] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:06:03 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:03.671471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906542-dc53-4e84-ae57-6c091853d877 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.706444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ab444-a694-45d6-b5ca-b94e77179f15 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:03.744736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512e2e-d77c-45ba-9ed7-2287ea1f2d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:03.745365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512e2e-d77c-45ba-9ed7-2287ea1f2d10 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.745645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512e2e-d77c-45ba-9ed7-2287ea1f2d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.745931 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512e2e-d77c-45ba-9ed7-2287ea1f2d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.776872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b906542-dc53-4e84-ae57-6c091853d877 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:03.811983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:03.812589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:03.812864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:03.813164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:03.813880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] RBAC: Adding query filter params (group.id=861225dba2d94bfda6bc52de7fc8bfa2, role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=1be4be6e21b140929ca372bd03dc82ab) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:03.814185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:03.815613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:03.817025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd512e2e-d77c-45ba-9ed7-2287ea1f2d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:03.818509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd512e2e-d77c-45ba-9ed7-2287ea1f2d10 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:03.821601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 222/445] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:06:03 2022] GET /identity/v3/role_assignments?group.id=861225dba2d94bfda6bc52de7fc8bfa2&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:03.853273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.875059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:03.916427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:03.948949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 224/446] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:03.954950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512e2e-d77c-45ba-9ed7-2287ea1f2d10 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:03.977845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e0714-067f-479e-b27c-fc312cfebaa6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.015204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e081be-a3fa-4067-965e-c84333fbe794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.015404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e081be-a3fa-4067-965e-c84333fbe794 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.015645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e081be-a3fa-4067-965e-c84333fbe794 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.015919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e081be-a3fa-4067-965e-c84333fbe794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.029492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e081be-a3fa-4067-965e-c84333fbe794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-27e081be-a3fa-4067-965e-c84333fbe794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:04.035072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:04.036298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:04.037702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 223/447] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:04.041960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e081be-a3fa-4067-965e-c84333fbe794 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:04.062872 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512e2e-d77c-45ba-9ed7-2287ea1f2d10 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.096633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de529-860a-4fff-b823-a5c9252adce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.097369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de529-860a-4fff-b823-a5c9252adce7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.097663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de529-860a-4fff-b823-a5c9252adce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.098025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73de529-860a-4fff-b823-a5c9252adce7 None admin] PATH_INFO: `/v3/projects/1be4be6e21b140929ca372bd03dc82ab` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.099156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73de529-860a-4fff-b823-a5c9252adce7 None admin] RBAC: Authorizing `identity:get_project(project_id=1be4be6e21b140929ca372bd03dc82ab)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:04.100603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73de529-860a-4fff-b823-a5c9252adce7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:04.102273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 225/448] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:06:03 2022] GET /identity/v3/projects/1be4be6e21b140929ca372bd03dc82ab => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:04.107698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de529-860a-4fff-b823-a5c9252adce7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:04.116266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:04.141492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e081be-a3fa-4067-965e-c84333fbe794 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.151763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:04.175284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.175869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.176143 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.176410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.177076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:04.177399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:04.178779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:04.186804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 224/449] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:04.192445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:04.206132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73de529-860a-4fff-b823-a5c9252adce7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.238200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee48e-d771-4e1a-af99-11096fb5573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.238936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee48e-d771-4e1a-af99-11096fb5573d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.239281 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee48e-d771-4e1a-af99-11096fb5573d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.239622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee48e-d771-4e1a-af99-11096fb5573d None admin] PATH_INFO: `/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.240840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee48e-d771-4e1a-af99-11096fb5573d None admin] RBAC: Authorizing `identity:get_group(group_id=861225dba2d94bfda6bc52de7fc8bfa2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:04.242316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee48e-d771-4e1a-af99-11096fb5573d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:04.243893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 226/450] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:06:04 2022] GET /identity/v3/groups/861225dba2d94bfda6bc52de7fc8bfa2 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:04.249750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee48e-d771-4e1a-af99-11096fb5573d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:04.288964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715539c-de0b-4f70-885f-8924d00918b9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.322100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:04.326465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca4af-191f-4fb1-b018-d8b2f5854409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.327289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca4af-191f-4fb1-b018-d8b2f5854409 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.327565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca4af-191f-4fb1-b018-d8b2f5854409 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.327837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca4af-191f-4fb1-b018-d8b2f5854409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.346946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee48e-d771-4e1a-af99-11096fb5573d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.369275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:04.380415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.381068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.381370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.381639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.382358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] RBAC: Adding query filter params (group.id=861225dba2d94bfda6bc52de7fc8bfa2, role.id=d2a6b97a907440368eca7f9387b778d6, scope.project.id=1be4be6e21b140929ca372bd03dc82ab) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:04.382655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:04.384043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:04.390076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 227/451] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:06:04 2022] GET /identity/v3/role_assignments?group.id=861225dba2d94bfda6bc52de7fc8bfa2&scope.project.id=1be4be6e21b140929ca372bd03dc82ab&role.id=d2a6b97a907440368eca7f9387b778d6 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:04.396590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca4af-191f-4fb1-b018-d8b2f5854409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:04.398120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca4af-191f-4fb1-b018-d8b2f5854409 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:04.507302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 225/452] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 05:06:04.513347 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:04.618247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e7867-8850-4393-8d76-beb48ee1b61c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.656674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce4a74-f9da-40fe-934a-c6f9e9d216cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.657321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce4a74-f9da-40fe-934a-c6f9e9d216cb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.660098 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce4a74-f9da-40fe-934a-c6f9e9d216cb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.660098 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce4a74-f9da-40fe-934a-c6f9e9d216cb None admin] PATH_INFO: `/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.660098 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce4a74-f9da-40fe-934a-c6f9e9d216cb None admin] RBAC: Authorizing `identity:get_project(project_id=2e8c567a5ea14fdea15f5fb60bb768ec)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:04.660546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce4a74-f9da-40fe-934a-c6f9e9d216cb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:04.662247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 228/453] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:06:04 2022] GET /identity/v3/projects/2e8c567a5ea14fdea15f5fb60bb768ec => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:04.667974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca4af-191f-4fb1-b018-d8b2f5854409 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:04.741121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:04.772178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca4af-191f-4fb1-b018-d8b2f5854409 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.808631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb679e-fc50-4bd7-a267-32efab9c9f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.809300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb679e-fc50-4bd7-a267-32efab9c9f5c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.809578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb679e-fc50-4bd7-a267-32efab9c9f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.809820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb679e-fc50-4bd7-a267-32efab9c9f5c None admin] PATH_INFO: `/v3/groups/6444ac321dc14319a935dd7f843ff38f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.810940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb679e-fc50-4bd7-a267-32efab9c9f5c None admin] RBAC: Authorizing `identity:get_group(group_id=6444ac321dc14319a935dd7f843ff38f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:04.812373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb679e-fc50-4bd7-a267-32efab9c9f5c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:04.814021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 226/454] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Aug 31 05:06:04 2022] GET /identity/v3/groups/6444ac321dc14319a935dd7f843ff38f => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:04.820384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce4a74-f9da-40fe-934a-c6f9e9d216cb None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:04.830280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:04.923885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce4a74-f9da-40fe-934a-c6f9e9d216cb None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:04.961826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e3f8-fb36-4ab8-88f5-f7bcaaa36a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:04.962425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e3f8-fb36-4ab8-88f5-f7bcaaa36a7d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:04.962703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e3f8-fb36-4ab8-88f5-f7bcaaa36a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:04.962975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e3f8-fb36-4ab8-88f5-f7bcaaa36a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:04.963703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84e3f8-fb36-4ab8-88f5-f7bcaaa36a7d None admin] RBAC: Adding query filter params (group.id=6444ac321dc14319a935dd7f843ff38f, role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=2e8c567a5ea14fdea15f5fb60bb768ec) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:04.964011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84e3f8-fb36-4ab8-88f5-f7bcaaa36a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:04.965514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84e3f8-fb36-4ab8-88f5-f7bcaaa36a7d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:04.971390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 229/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Aug 31 05:06:04 2022] GET /identity/v3/role_assignments?group.id=6444ac321dc14319a935dd7f843ff38f&scope.project.id=2e8c567a5ea14fdea15f5fb60bb768ec&role.id=6da07502c09e4fc8afb31b58e434479b => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:07.426205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983874-7c31-475c-a31f-dc607df77bbc None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:07.427274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983874-7c31-475c-a31f-dc607df77bbc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:07.427748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983874-7c31-475c-a31f-dc607df77bbc None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:07.429577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 227/456] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:07.435030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc813-8304-4100-a7ff-fb79bc65ce61 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:07.435830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc813-8304-4100-a7ff-fb79bc65ce61 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:07.436297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc813-8304-4100-a7ff-fb79bc65ce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:07.463915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ba7fc813-8304-4100-a7ff-fb79bc65ce61 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:07.466360 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ba7fc813-8304-4100-a7ff-fb79bc65ce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:07.485791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295372e-9d40-43b4-932f-961813323e00 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:07.486083 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295372e-9d40-43b4-932f-961813323e00 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:07.486332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295372e-9d40-43b4-932f-961813323e00 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:07.488006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 228/457] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:07.494941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e83e-cb2a-4a20-b4df-f15989781de9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:07.495218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e83e-cb2a-4a20-b4df-f15989781de9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:07.495489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3e83e-cb2a-4a20-b4df-f15989781de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:07.526149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-77b3e83e-cb2a-4a20-b4df-f15989781de9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:07.527377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-77b3e83e-cb2a-4a20-b4df-f15989781de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:07.557080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:07.560342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 230/458] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:07.652731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 229/459] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:06:07.914281 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fc813-8304-4100-a7ff-fb79bc65ce61 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:07.918949 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3e83e-cb2a-4a20-b4df-f15989781de9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:08.046664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:08.054118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fc813-8304-4100-a7ff-fb79bc65ce61 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:08.081261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3e83e-cb2a-4a20-b4df-f15989781de9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:08.093324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00603d1e-f032-4a9d-a600-18036858ebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:08.094434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00603d1e-f032-4a9d-a600-18036858ebdb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.094895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00603d1e-f032-4a9d-a600-18036858ebdb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.095543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00603d1e-f032-4a9d-a600-18036858ebdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.109600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00603d1e-f032-4a9d-a600-18036858ebdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:08.111743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00603d1e-f032-4a9d-a600-18036858ebdb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:08.120474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c190e3-58f2-4d15-b4d3-32d3d374bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:08.121790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c190e3-58f2-4d15-b4d3-32d3d374bc93 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.122212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c190e3-58f2-4d15-b4d3-32d3d374bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.122743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c190e3-58f2-4d15-b4d3-32d3d374bc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-00603d1e-f032-4a9d-a600-18036858ebdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:08.127850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:08.129236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:08.130349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:08.130349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:08.130349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:08.135293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 231/460] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:08.136486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c190e3-58f2-4d15-b4d3-32d3d374bc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:08.136602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be988-b1c9-4964-94f7-f8e76aab2a59 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.136828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be988-b1c9-4964-94f7-f8e76aab2a59 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.137116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056be988-b1c9-4964-94f7-f8e76aab2a59 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.138397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 232/461] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:08.138984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c190e3-58f2-4d15-b4d3-32d3d374bc93 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:08.139821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056be988-b1c9-4964-94f7-f8e76aab2a59 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d1c190e3-58f2-4d15-b4d3-32d3d374bc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:08.159938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:08.160903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:08.161847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:08.161847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:08.161847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:08.164840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 230/462] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:08.166282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ed705-f0ea-48ca-8821-79f25029dfd8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.166778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ed705-f0ea-48ca-8821-79f25029dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.167245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ed705-f0ea-48ca-8821-79f25029dfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.191650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-276ed705-f0ea-48ca-8821-79f25029dfd8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:08.193456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-276ed705-f0ea-48ca-8821-79f25029dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:08.204430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:08.272750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 231/463] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:08.274103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ed705-f0ea-48ca-8821-79f25029dfd8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:08.275706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056be988-b1c9-4964-94f7-f8e76aab2a59 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:08.318812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:08.320077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.320568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.321285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.322180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:08.322920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:08.324884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:08.330608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:08.341475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 233/464] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:08.349217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:08.407656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ed705-f0ea-48ca-8821-79f25029dfd8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:08.451479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7b2ea-0ce3-4149-b3a0-e13393cf3ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:08.452872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b2ea-0ce3-4149-b3a0-e13393cf3ecd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.453700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b2ea-0ce3-4149-b3a0-e13393cf3ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.454115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b2ea-0ce3-4149-b3a0-e13393cf3ecd None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.455140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b2ea-0ce3-4149-b3a0-e13393cf3ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:08.455582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b2ea-0ce3-4149-b3a0-e13393cf3ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:08.457639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b2ea-0ce3-4149-b3a0-e13393cf3ecd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:08.476135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cb084-3daf-4f04-91b8-64c7f81490a3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:08.481642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 232/465] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:08.481642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45bab-e273-4fe8-8d74-34b3039cf985 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.481642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45bab-e273-4fe8-8d74-34b3039cf985 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.481642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45bab-e273-4fe8-8d74-34b3039cf985 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.484840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 233/466] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:08.486299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def92e3f-89eb-4ab0-ac4e-2b6ed4c1bd9b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.486578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def92e3f-89eb-4ab0-ac4e-2b6ed4c1bd9b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.486847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def92e3f-89eb-4ab0-ac4e-2b6ed4c1bd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.498870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:08.506439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-def92e3f-89eb-4ab0-ac4e-2b6ed4c1bd9b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:08.507635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-def92e3f-89eb-4ab0-ac4e-2b6ed4c1bd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:08.528693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0402-af72-4b5d-91ec-f3de78413e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:08.529334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0402-af72-4b5d-91ec-f3de78413e2c None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.529606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0402-af72-4b5d-91ec-f3de78413e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.529875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc0402-af72-4b5d-91ec-f3de78413e2c None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.530519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc0402-af72-4b5d-91ec-f3de78413e2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:08.531931 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc0402-af72-4b5d-91ec-f3de78413e2c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:08.564017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 234/467] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:06:08 2022] POST /identity/v3/users => generated 246 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:06:08.564017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0402-af72-4b5d-91ec-f3de78413e2c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:08.599224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 234/468] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:08.600587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def92e3f-89eb-4ab0-ac4e-2b6ed4c1bd9b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:08.706559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:08.739820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc0402-af72-4b5d-91ec-f3de78413e2c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:08.774958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def92e3f-89eb-4ab0-ac4e-2b6ed4c1bd9b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:08.779327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f944b5-40da-4e0a-b2e3-e5984fc5209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:08.779958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f944b5-40da-4e0a-b2e3-e5984fc5209c None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.780241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f944b5-40da-4e0a-b2e3-e5984fc5209c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.780516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f944b5-40da-4e0a-b2e3-e5984fc5209c None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.781205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f944b5-40da-4e0a-b2e3-e5984fc5209c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:08.782658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f944b5-40da-4e0a-b2e3-e5984fc5209c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:08.807863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 235/469] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:06:08 2022] POST /identity/v3/users => generated 248 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:08.810135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babc63d-7c35-4544-9e15-cee0e61aa39f None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.810425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babc63d-7c35-4544-9e15-cee0e61aa39f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.811176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babc63d-7c35-4544-9e15-cee0e61aa39f None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.815808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 236/470] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:08.817707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9413a7-899b-47d5-9eb0-beb4cefa2ea8 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.818034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9413a7-899b-47d5-9eb0-beb4cefa2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.818307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9413a7-899b-47d5-9eb0-beb4cefa2ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.823458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:08.823656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:08.823911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:08.824312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:08.837813 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:08.839460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:08.842485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-6f9413a7-899b-47d5-9eb0-beb4cefa2ea8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:08.843987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6f9413a7-899b-47d5-9eb0-beb4cefa2ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:08.857539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:08.858556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:08.859432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:08.859432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:08.859432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:08.859432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 235/471] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:08.865427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:08.868378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:08.925494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 237/472] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:08.926712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9413a7-899b-47d5-9eb0-beb4cefa2ea8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:09.000695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:09.013697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34031a61-46a5-4fd7-b74b-3880ca4d15be None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:09.032323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9413a7-899b-47d5-9eb0-beb4cefa2ea8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:09.067554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:09.068171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:09.068446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:09.068709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:09.069412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:09.069708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:09.070351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:09.071134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:09.071415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:09.071880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:09.072339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:09.083478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:09.085180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:09.087350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 236/473] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:09.093149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:09.101198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:09.102339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:09.103278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:09.103278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:09.103278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:09.105175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 238/474] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:09.113110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:09.121387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:09.224460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412245aa-3e33-4613-83e1-3c6a285b10dd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:09.242302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842c13-3bc2-41ac-be5c-67dd071180fb None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:09.269356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e851b4-8273-42fd-8fd1-be7544ef446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:09.270299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e851b4-8273-42fd-8fd1-be7544ef446c None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:09.270895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e851b4-8273-42fd-8fd1-be7544ef446c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:09.271352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e851b4-8273-42fd-8fd1-be7544ef446c None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:09.272115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e851b4-8273-42fd-8fd1-be7544ef446c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:09.273731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e851b4-8273-42fd-8fd1-be7544ef446c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:09.279193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:09.279803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:09.280081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:09.280350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:09.280998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:09.281343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:09.282711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:09.297672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 239/475] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:09.298751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:09.299128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 237/476] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:06:09 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:09.303510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e851b4-8273-42fd-8fd1-be7544ef446c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:09.347823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:09.388126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:09.434332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cb28f-2045-4075-93f7-45c3243a51d6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:09.476737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:09.478244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:09.478774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:09.479236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:09.480077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:09.481974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:09.492077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.sql.core [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 05:06:09.492077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 05:06:09.492077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [parameters: {'id': '9dc80e09c6b74fb79938f138d80d2334', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 05:06:09.492077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81574) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application conn.query(q) Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result.read() Aug 31 05:06:09.512524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 05:06:09.513661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application next(self.gen) Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application yield resource Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application next(self.gen) Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise self.value Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application session.commit() Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 05:06:09.514984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.session.flush() Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application compat.raise_( Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 05:06:09.515880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 05:06:09.517026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application conn.query(q) Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result.read() Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 05:06:09.518770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [parameters: {'id': '9dc80e09c6b74fb79938f138d80d2334', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:09.520489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 05:06:09.522221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:09.525727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 240/477] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 31 05:06:09 2022] POST /identity/v3/roles => generated 144 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:09.532725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e851b4-8273-42fd-8fd1-be7544ef446c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:09.535644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:09.573361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa963118-1e28-4542-a4a1-a2b57154fc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:09.574227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa963118-1e28-4542-a4a1-a2b57154fc77 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:09.574660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa963118-1e28-4542-a4a1-a2b57154fc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:09.574939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa963118-1e28-4542-a4a1-a2b57154fc77 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:09.575652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa963118-1e28-4542-a4a1-a2b57154fc77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:09.577876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa963118-1e28-4542-a4a1-a2b57154fc77 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:09.603676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 238/478] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:06:09 2022] POST /identity/v3/users => generated 249 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:06:09.675143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33854-d864-45b2-b344-fa55014a2dbd None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:09.715236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:09.723901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ad4e-e7dc-4734-874d-804ef29c216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:09.724566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ad4e-e7dc-4734-874d-804ef29c216c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:09.724843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ad4e-e7dc-4734-874d-804ef29c216c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:09.725161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ad4e-e7dc-4734-874d-804ef29c216c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:09.737534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ad4e-e7dc-4734-874d-804ef29c216c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-e0b3ad4e-e7dc-4734-874d-804ef29c216c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:09.742760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:09.743720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:09.745003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 241/479] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:09.750130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa963118-1e28-4542-a4a1-a2b57154fc77 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:09.825856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:09.864439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa963118-1e28-4542-a4a1-a2b57154fc77 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:09.899919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f41e5-e898-4325-a1a8-b9cffb05b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:09.900892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f41e5-e898-4325-a1a8-b9cffb05b731 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:09.901440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f41e5-e898-4325-a1a8-b9cffb05b731 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:09.901903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f41e5-e898-4325-a1a8-b9cffb05b731 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:09.902835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f41e5-e898-4325-a1a8-b9cffb05b731 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:09.903329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f41e5-e898-4325-a1a8-b9cffb05b731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:09.904890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f41e5-e898-4325-a1a8-b9cffb05b731 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:09.914397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 239/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:10.830717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ab3b6-3fc5-465e-bf86-fc81a4697d89 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:10.831270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ab3b6-3fc5-465e-bf86-fc81a4697d89 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:10.831270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ab3b6-3fc5-465e-bf86-fc81a4697d89 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:10.833044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 242/481] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:10.837926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869716-932f-4501-9272-1f2dc421e56e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:10.838709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869716-932f-4501-9272-1f2dc421e56e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:10.839200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3869716-932f-4501-9272-1f2dc421e56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:10.861915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e3869716-932f-4501-9272-1f2dc421e56e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:10.863614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e3869716-932f-4501-9272-1f2dc421e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:10.945058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 240/482] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:11.286813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ab3b6-3fc5-465e-bf86-fc81a4697d89 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:11.414741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ab3b6-3fc5-465e-bf86-fc81a4697d89 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:11.463661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb320ab8-a1d4-4bbb-a326-63023da6a844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:11.464296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320ab8-a1d4-4bbb-a326-63023da6a844 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:11.464567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320ab8-a1d4-4bbb-a326-63023da6a844 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:11.464827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320ab8-a1d4-4bbb-a326-63023da6a844 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:11.479181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb320ab8-a1d4-4bbb-a326-63023da6a844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-fb320ab8-a1d4-4bbb-a326-63023da6a844 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:11.483936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:11.484848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:11.486080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 243/483] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:11.491911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3869716-932f-4501-9272-1f2dc421e56e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:11.564323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:11.595134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3bed-35c7-4274-b782-8800c17c19d5 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:11.595449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3bed-35c7-4274-b782-8800c17c19d5 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:11.595671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3bed-35c7-4274-b782-8800c17c19d5 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:11.597005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 244/484] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:06:11.603483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606fea-d9c4-405c-bb6f-2414680d1afc None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:11.603765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606fea-d9c4-405c-bb6f-2414680d1afc None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:11.604040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e606fea-d9c4-405c-bb6f-2414680d1afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:11.620151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3869716-932f-4501-9272-1f2dc421e56e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:11.642247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-3e606fea-d9c4-405c-bb6f-2414680d1afc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:11.643513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3e606fea-d9c4-405c-bb6f-2414680d1afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:11.664525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83c2fa-044e-4f69-a462-bd3a93252872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:11.665178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83c2fa-044e-4f69-a462-bd3a93252872 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:11.665458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83c2fa-044e-4f69-a462-bd3a93252872 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:11.665723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83c2fa-044e-4f69-a462-bd3a93252872 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:11.666455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83c2fa-044e-4f69-a462-bd3a93252872 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:11.666861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83c2fa-044e-4f69-a462-bd3a93252872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:11.668231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83c2fa-044e-4f69-a462-bd3a93252872 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:11.679397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 241/485] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:11.680732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd9f06-ce30-4fb4-a726-0f55ca2911a3 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:11.685402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd9f06-ce30-4fb4-a726-0f55ca2911a3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:11.685745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd9f06-ce30-4fb4-a726-0f55ca2911a3 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:11.690211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 242/486] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:11.691069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd9f06-ce30-4fb4-a726-0f55ca2911a3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:11.703874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:11.731422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 245/487] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:11.732787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703305a9-5a33-4ae3-8add-4f102f182777 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:11.733346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703305a9-5a33-4ae3-8add-4f102f182777 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:11.733619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703305a9-5a33-4ae3-8add-4f102f182777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:11.753171 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-703305a9-5a33-4ae3-8add-4f102f182777 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:11.754679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-703305a9-5a33-4ae3-8add-4f102f182777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:11.825828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd9f06-ce30-4fb4-a726-0f55ca2911a3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:11.857004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 246/488] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:11.862164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:11.877778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:11.878408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:11.878733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:11.879003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:11.890382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:11.891836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:11.906274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:11.907203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:11.908451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:11.908451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:11.908451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:11.908451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 243/489] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:11.913576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703305a9-5a33-4ae3-8add-4f102f182777 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.029493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703305a9-5a33-4ae3-8add-4f102f182777 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.045554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:12.070774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.071379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.071652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.071920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.072560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:12.072857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:12.074245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:12.091600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 247/490] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:12.097176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.167578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.205643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71996ceb-1151-4477-8818-4651fd200085 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.243135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.244167 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.244639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.245118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.253347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:12.255076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:12.268686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:12.269792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:12.271033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:12.273000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 244/491] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:12.273977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.300396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a5dbb-e234-4c4d-8058-8a590ee6b61b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.307284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:12.334799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065541f-64ed-4348-a2b8-ec6b2fd257c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.335423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065541f-64ed-4348-a2b8-ec6b2fd257c9 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.335697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065541f-64ed-4348-a2b8-ec6b2fd257c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.335961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065541f-64ed-4348-a2b8-ec6b2fd257c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.346288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065541f-64ed-4348-a2b8-ec6b2fd257c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-4065541f-64ed-4348-a2b8-ec6b2fd257c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:12.351532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:12.352443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:12.353703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 248/492] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:12.354529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d536ae-7c79-49b3-afce-319e5b0588c3 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.354529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d536ae-7c79-49b3-afce-319e5b0588c3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.354707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d536ae-7c79-49b3-afce-319e5b0588c3 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.356226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 249/493] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:12.357132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d536ae-7c79-49b3-afce-319e5b0588c3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.385968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7868bb-62b1-4c68-a62f-2c841b726828 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.391192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:12.426332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833282c-6fea-4e4f-ac4b-88d0af34dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.427439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833282c-6fea-4e4f-ac4b-88d0af34dc49 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.428171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833282c-6fea-4e4f-ac4b-88d0af34dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.428831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833282c-6fea-4e4f-ac4b-88d0af34dc49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.440578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833282c-6fea-4e4f-ac4b-88d0af34dc49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3833282c-6fea-4e4f-ac4b-88d0af34dc49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:12.448279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:12.449330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:12.450177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:12.451408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 245/494] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:12.452058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833282c-6fea-4e4f-ac4b-88d0af34dc49 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.474214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d536ae-7c79-49b3-afce-319e5b0588c3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.514993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a94c5a-5323-49bb-9c07-32e8b098799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.515596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94c5a-5323-49bb-9c07-32e8b098799e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.515876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94c5a-5323-49bb-9c07-32e8b098799e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.516144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a94c5a-5323-49bb-9c07-32e8b098799e None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.516927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94c5a-5323-49bb-9c07-32e8b098799e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:12.517207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94c5a-5323-49bb-9c07-32e8b098799e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:12.518655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a94c5a-5323-49bb-9c07-32e8b098799e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:12.548640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:12.556659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 250/495] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:12.557992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089dfff-6bad-41d2-ab3f-af5db2f7ad70 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.558279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089dfff-6bad-41d2-ab3f-af5db2f7ad70 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.558550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089dfff-6bad-41d2-ab3f-af5db2f7ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.559119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833282c-6fea-4e4f-ac4b-88d0af34dc49 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.576662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d089dfff-6bad-41d2-ab3f-af5db2f7ad70 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:12.577894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d089dfff-6bad-41d2-ab3f-af5db2f7ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:12.592141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.592767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.593039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.593334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.593977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:12.594274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:12.595637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:12.603696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 246/496] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:12.604393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.652927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 251/497] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:12.654242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fafd0-50bf-4e0f-bd1e-5fb49119d2bf None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.654520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fafd0-50bf-4e0f-bd1e-5fb49119d2bf None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.654787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fafd0-50bf-4e0f-bd1e-5fb49119d2bf None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.656027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 252/498] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:12.656705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fafd0-50bf-4e0f-bd1e-5fb49119d2bf None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.681338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:12.711683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd3725-892a-4f63-8528-69c8f574756c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.747084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.747709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.748018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.748317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.749008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:12.749368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:12.750770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:12.763833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 247/499] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:12.763833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:12.773383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fafd0-50bf-4e0f-bd1e-5fb49119d2bf None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.780043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:12.811199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225b7de-4e36-41c4-8c38-1938dd180d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.811798 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225b7de-4e36-41c4-8c38-1938dd180d03 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.812071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225b7de-4e36-41c4-8c38-1938dd180d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.812341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225b7de-4e36-41c4-8c38-1938dd180d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.865967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d82dfc-744f-4e52-b5ae-ee13589c7100 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:12.880572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225b7de-4e36-41c4-8c38-1938dd180d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:12.882071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225b7de-4e36-41c4-8c38-1938dd180d03 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:12.900562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:12.903560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35442dd6-5e5f-49b3-9fe8-7ce9f922728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:12.904389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442dd6-5e5f-49b3-9fe8-7ce9f922728d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.904872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442dd6-5e5f-49b3-9fe8-7ce9f922728d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.905160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442dd6-5e5f-49b3-9fe8-7ce9f922728d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.916672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35442dd6-5e5f-49b3-9fe8-7ce9f922728d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:12.918161 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35442dd6-5e5f-49b3-9fe8-7ce9f922728d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-35442dd6-5e5f-49b3-9fe8-7ce9f922728d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:12.932322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:12.938269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:12.939417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:12.939417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:12.939417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:12.939417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 248/500] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:12.939417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4066a6-faf2-413b-9660-3f2817c77e39 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:12.939417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4066a6-faf2-413b-9660-3f2817c77e39 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:12.939417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4066a6-faf2-413b-9660-3f2817c77e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:12.954242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bb4066a6-faf2-413b-9660-3f2817c77e39 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:12.955435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bb4066a6-faf2-413b-9660-3f2817c77e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:12.982722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 253/501] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:12.983563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225b7de-4e36-41c4-8c38-1938dd180d03 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.020125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.025822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 249/502] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:13.026978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4066a6-faf2-413b-9660-3f2817c77e39 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.082288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225b7de-4e36-41c4-8c38-1938dd180d03 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.101269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.119313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.119848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.120129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.120403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.131244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.132895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.134218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4066a6-faf2-413b-9660-3f2817c77e39 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:13.150393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:13.151408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:13.152278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:13.152278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:13.152278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:13.152278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 254/503] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:13.152278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.176924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e010bb-38b9-497a-acaf-4386e42ec4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.177565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e010bb-38b9-497a-acaf-4386e42ec4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.177846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e010bb-38b9-497a-acaf-4386e42ec4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.178116 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e010bb-38b9-497a-acaf-4386e42ec4b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.188528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e010bb-38b9-497a-acaf-4386e42ec4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c8e010bb-38b9-497a-acaf-4386e42ec4b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:13.193431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:13.194335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:13.195156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 250/504] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:13.195840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e010bb-38b9-497a-acaf-4386e42ec4b8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.256172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.263866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b87cd4-a0d1-481c-983b-fd446a0f4b73 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.297680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.298286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.298562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.298835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.299469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:13.299769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.301169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.301842 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e010bb-38b9-497a-acaf-4386e42ec4b8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.312589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 255/505] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:13.313381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.336415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.337050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.337352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.337617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.343910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.347949 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.349442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:13.364320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:13.365467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:13.366524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:13.366524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:13.366524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:13.366524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 251/506] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:13.370473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.415941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3fd34-9a6c-4a6c-b80c-b5ed91ae2081 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.449636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.450329 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.450599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.450866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.451515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:13.451816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.453205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.464199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 256/507] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:13.465901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.469827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807eda0-47d2-46fd-a635-ab162924308f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.480126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.503804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.504410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.504684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.504952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.505644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:13.505943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.507316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.522571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 252/508] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:13.522571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.556634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.568551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dbb8a-cf39-4d9d-a252-a7776babc703 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.601663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.602274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.602552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.602815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.613192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.614625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.626131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33ee59-237f-46f1-b6e0-fd7fea09bfbb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:13.633044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:13.634174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:13.635162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:13.635162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:13.635162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:13.635162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 257/509] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:13.636203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.660422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.661054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.661363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.661631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.668985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.670474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:13.682366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:13.683307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:13.684227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 253/510] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:13.684845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.716635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.755127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a2aeb-bb7e-4635-91aa-1f4936873bdf None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.790797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7065149a-7997-458d-b08a-298bb965f236 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.790989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.791524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.791801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.792069 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.792711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:13.792978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.794370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.807158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 258/511] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:13.807158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.809703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.830830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.831470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.831795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.832065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.839547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.840978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:13.851946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:13.853038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 254/512] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:13.854290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.914443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139f218-86ea-4025-8112-c336c923a6db None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.941625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:13.948797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.949451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.949731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.949997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.951141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd597ef-7a4b-4a67-baaa-5599a88c3f14 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:13.960339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.961825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:13.976685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:13.977780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:13.978687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:13.978687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:13.978687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:13.978687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 259/513] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:13.978905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:13.991026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:13.991647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:13.991924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:13.992199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:13.992825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:13.993130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:13.994485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.008516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 255/514] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:14.008516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.034348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.079245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e071c-22a7-48f7-adfc-c304ee3ef390 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.105790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914797c-d6d5-48d9-8190-dbf665fd1d22 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.112303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.112941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.113348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.113805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.114573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:14.114909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.116327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.134728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 260/515] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 31 05:06:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:14.135576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.142393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.143155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.143467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.143780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.150911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.152366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:14.164212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:14.165387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 256/516] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:14.166466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.181547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.240160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57200-48de-4625-83f2-41a5f50609d7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.252976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.268609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f191c-3b00-424d-a9ef-55f020c0f1c9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.274696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.275339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.275615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.275884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.276616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:14.276921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.278403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.295106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 261/517] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:14.295887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.302369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.303009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.303286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.303536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.304179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:14.304489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.305937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.317798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 257/518] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:14.318594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.388176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.397448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c9e83-5528-4323-bc6f-500e41346d07 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.417883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a13e6b-7079-4592-8679-7824713159d5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.434737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b1e2b-c0ed-44c9-af01-13255881218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.435345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b1e2b-c0ed-44c9-af01-13255881218a None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.435621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b1e2b-c0ed-44c9-af01-13255881218a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.435886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b1e2b-c0ed-44c9-af01-13255881218a None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.436533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b1e2b-c0ed-44c9-af01-13255881218a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.438004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13b1e2b-c0ed-44c9-af01-13255881218a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.453801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634c5e2-6d1b-4af1-9ed9-9c2f69092e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.454550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634c5e2-6d1b-4af1-9ed9-9c2f69092e8c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.454850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634c5e2-6d1b-4af1-9ed9-9c2f69092e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.455113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634c5e2-6d1b-4af1-9ed9-9c2f69092e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.459742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 262/519] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:06:14 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:14.460548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b1e2b-c0ed-44c9-af01-13255881218a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.501224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.546763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634c5e2-6d1b-4af1-9ed9-9c2f69092e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.548226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634c5e2-6d1b-4af1-9ed9-9c2f69092e8c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.583169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b1e2b-c0ed-44c9-af01-13255881218a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.620777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.621440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.621719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.621990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.622689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:14.622993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.624454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.634088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.643587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 263/520] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:14.648772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.675022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 258/521] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:14.675753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634c5e2-6d1b-4af1-9ed9-9c2f69092e8c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.736895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.755442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bff6ac-e3ea-406a-92df-99354bfc007b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.781701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634c5e2-6d1b-4af1-9ed9-9c2f69092e8c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.793134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11273f42-d628-4c2d-a15f-614917db45db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.793759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273f42-d628-4c2d-a15f-614917db45db None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.794042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273f42-d628-4c2d-a15f-614917db45db None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.794310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273f42-d628-4c2d-a15f-614917db45db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.820570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.821686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.822160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.822602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.830656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.832782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:14.845164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:14.846131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 05:06:14.847051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:14.851005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 259/522] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:14.851874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.864865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11273f42-d628-4c2d-a15f-614917db45db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:14.866552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11273f42-d628-4c2d-a15f-614917db45db None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:14.883077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.955957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5930e1c-3091-4d69-b23e-376d20185728 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:14.959930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:14.977725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 264/523] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:14.978889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11273f42-d628-4c2d-a15f-614917db45db None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:14.997584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:14.998187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:14.998462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:14.998731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:14.999452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=7f5576a90945429a9127a2d4c53a729c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:14.999754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.001227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.007037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 260/524] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/role_assignments?user.id=7f5576a90945429a9127a2d4c53a729c&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:15.007832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.124265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:15.131252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11273f42-d628-4c2d-a15f-614917db45db None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.131583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd33309-8dac-418a-8745-c0035a1dcd2c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.171762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.172392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.172670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.172944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.173712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:15.174018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.175541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.189013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.189821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.190189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.190618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.201854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.204295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.216395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 261/525] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:15.217573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:15.226021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:15.227066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:15.227986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:15.227986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:15.227986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:15.227986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 265/526] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:15.228899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.279727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:15.332369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8591c9-8eb1-48e2-9948-28bd36095764 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.356074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cb03d-0c6e-4c34-8a17-fef300aaeb7a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.370346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.371472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.371968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.372598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.384369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.386329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.393190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908c71b-2cdf-42e6-9c1a-cfe74e3a8dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.393806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908c71b-2cdf-42e6-9c1a-cfe74e3a8dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.394303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908c71b-2cdf-42e6-9c1a-cfe74e3a8dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.394475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908c71b-2cdf-42e6-9c1a-cfe74e3a8dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:15.403604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:15.404604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:15.405489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:15.405489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:15.405489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:15.412391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 262/527] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:15.413659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.424895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:15.464726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908c71b-2cdf-42e6-9c1a-cfe74e3a8dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.466178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908c71b-2cdf-42e6-9c1a-cfe74e3a8dc8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.507520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:15.530181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041736f-5ec7-4d16-a05e-1c219e8aad82 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.568094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.569065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.569605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.570162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.570998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:15.571487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.573070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.575318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 266/528] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 05:06:15.576437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908c71b-2cdf-42e6-9c1a-cfe74e3a8dc8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.587331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 263/529] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:15.588598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.682958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908c71b-2cdf-42e6-9c1a-cfe74e3a8dc8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.683826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:15.719891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.720507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.720838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.721050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.721738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:15.722041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.723636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.730470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3924048-794d-40b2-ae80-e5e452ff06fc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.731744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:15.737898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 267/530] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:15.739073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.778759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.779636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.780059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.780469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.796891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.798815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:15.818695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:15.819852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:15.820953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:15.820953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:15.820953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:15.823155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 264/531] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:15.824120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.852712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f90730-d281-4fd8-9bc2-6346ecbc1faf None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.896694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.898330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.898821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.899514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.909596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.912138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:15.933290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:15.934431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:15.935523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:15.935523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:15.935523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:15.935523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:15.935523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:15.935523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:15.935523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:15.935523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:15.942634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 268/532] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:15.942634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:15.951262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ca343-65a7-4d58-bbc6-1c2669fc3b00 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:15.968633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:15.986616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:15.987283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:15.988272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:15.988272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:15.995109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:15.996565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:16.008561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:16.009545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:16.010416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 265/533] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:16.010889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:16.017933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:16.066339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b1a50-e3aa-47b8-ac11-a2b4f5f134a6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:16.104278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:16.105384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.105884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.106352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.107317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:16.107963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:16.109694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.113968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b7922-005d-454e-ae59-be5675fe29d8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:16.125315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 269/534] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:16.126528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:16.155589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:16.156283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.156485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.156735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.157472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:16.157771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:16.159214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.182420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 266/535] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:16.182420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:16.223101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:16.248700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d5172-8baa-44f1-9748-639e5febb996 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:16.269012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:16.284258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b0ab2-e6e1-4c9e-b86d-fd5f578cd9fc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:16.290367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:16.291173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.291595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.292007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.292927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:16.293414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:16.295112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.308852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 270/536] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:16.310016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:16.320450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:16.321334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.321554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.321967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.329162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:16.330730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:16.342389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:16.343307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:16.344301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:16.344301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:16.344301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:16.344301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:16.344301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:16.344301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:16.344301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:16.344301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:16.348826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 267/537] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:16.349777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:16.426345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de2c58-d100-4f6e-bd07-0fc212d3ad97 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:16.449303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:16.452331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334bab-8bc6-42f4-b152-21efc817533e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:16.465877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:16.466908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.467365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.467812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.468720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=75e27abf26954289b3fcffa332e155a4) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:16.469294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:16.471008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.481321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 271/538] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:16 2022] GET /identity/v3/role_assignments?user.id=75e27abf26954289b3fcffa332e155a4&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:16.482478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:16.486427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2181a-336d-4270-adc2-db9f49adb0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:16.487200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2181a-336d-4270-adc2-db9f49adb0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.487430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2181a-336d-4270-adc2-db9f49adb0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.487697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2181a-336d-4270-adc2-db9f49adb0a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.488610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2181a-336d-4270-adc2-db9f49adb0a4 None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=24f45db0ea864a3299cccd7a74b7271b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:16.488918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2181a-336d-4270-adc2-db9f49adb0a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:16.493134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2181a-336d-4270-adc2-db9f49adb0a4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.502231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 268/539] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:16 2022] GET /identity/v3/role_assignments?user.id=24f45db0ea864a3299cccd7a74b7271b&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:16.502231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a04a-e9f7-4789-8467-11ac3e0b0692 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.502231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a04a-e9f7-4789-8467-11ac3e0b0692 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.502231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a04a-e9f7-4789-8467-11ac3e0b0692 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.502231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 269/540] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:16.512001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b172-9928-4fff-a355-b425c19d5c28 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.512534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b172-9928-4fff-a355-b425c19d5c28 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.512949 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b172-9928-4fff-a355-b425c19d5c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.552451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2108b172-9928-4fff-a355-b425c19d5c28 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:16.554439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2108b172-9928-4fff-a355-b425c19d5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:16.600930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:16.698254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40c9ff-6f31-4183-90c0-311ca8c9e882 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:16.705192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 270/541] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:06:16.735509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e21c-69e5-4abb-9360-5290b9412a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:16.736121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e21c-69e5-4abb-9360-5290b9412a20 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.736398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e21c-69e5-4abb-9360-5290b9412a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.736669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e21c-69e5-4abb-9360-5290b9412a20 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.737395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4e21c-69e5-4abb-9360-5290b9412a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:16.737697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4e21c-69e5-4abb-9360-5290b9412a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:16.739241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4e21c-69e5-4abb-9360-5290b9412a20 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.759296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 272/542] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:16.765959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108b172-9928-4fff-a355-b425c19d5c28 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:16.904707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:16.913312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108b172-9928-4fff-a355-b425c19d5c28 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:16.968053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f87aec-b3de-402d-bc09-e0edfd629152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:16.968671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f87aec-b3de-402d-bc09-e0edfd629152 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.969218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f87aec-b3de-402d-bc09-e0edfd629152 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.969218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f87aec-b3de-402d-bc09-e0edfd629152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.969948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f87aec-b3de-402d-bc09-e0edfd629152 None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=45dadcdc0903427ca598dcd0bf06a6ca) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:16.970254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f87aec-b3de-402d-bc09-e0edfd629152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:16.971694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f87aec-b3de-402d-bc09-e0edfd629152 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:16.981035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 271/543] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:16 2022] GET /identity/v3/role_assignments?user.id=45dadcdc0903427ca598dcd0bf06a6ca&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:16.981906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb40d0-4950-42f8-88aa-d8ae5263531d None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.982193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb40d0-4950-42f8-88aa-d8ae5263531d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.982471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb40d0-4950-42f8-88aa-d8ae5263531d None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:16.984025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 273/544] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:16.990031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632efe3a-86de-4b34-a512-d957dcbad960 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:16.990335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632efe3a-86de-4b34-a512-d957dcbad960 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:16.990584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632efe3a-86de-4b34-a512-d957dcbad960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:17.022414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-632efe3a-86de-4b34-a512-d957dcbad960 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:17.023695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-632efe3a-86de-4b34-a512-d957dcbad960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:17.098066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 272/545] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:17.135691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb40d0-4950-42f8-88aa-d8ae5263531d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:17.265792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb40d0-4950-42f8-88aa-d8ae5263531d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:17.267647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:17.307364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612b218-a59d-472a-afb9-f3543bae86cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:17.308353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b218-a59d-472a-afb9-f3543bae86cf None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:17.308820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b218-a59d-472a-afb9-f3543bae86cf None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:17.309304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b218-a59d-472a-afb9-f3543bae86cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:17.334020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612b218-a59d-472a-afb9-f3543bae86cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-2612b218-a59d-472a-afb9-f3543bae86cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:17.342010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:17.342891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:17.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 274/546] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:17.350876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632efe3a-86de-4b34-a512-d957dcbad960 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:17.442649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612b218-a59d-472a-afb9-f3543bae86cf None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:17.469262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:17.484277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632efe3a-86de-4b34-a512-d957dcbad960 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:17.555563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:17.556098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:17.556376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:17.556649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:17.557351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:17.557651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:17.559036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:17.566255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612b218-a59d-472a-afb9-f3543bae86cf None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:17.591416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 273/547] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:17.598760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:17.601467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6417519-4a73-47db-9f6b-091c59e4e289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:17.602164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6417519-4a73-47db-9f6b-091c59e4e289 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:17.602547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6417519-4a73-47db-9f6b-091c59e4e289 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:17.602857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6417519-4a73-47db-9f6b-091c59e4e289 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:17.613772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6417519-4a73-47db-9f6b-091c59e4e289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-f6417519-4a73-47db-9f6b-091c59e4e289 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:17.618930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:17.619843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:17.620687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 275/548] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:17.630266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6417519-4a73-47db-9f6b-091c59e4e289 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:17.656076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:17.739563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6417519-4a73-47db-9f6b-091c59e4e289 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:17.776924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:17.781289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:17.781289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:17.781289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:17.781289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:17.781289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:17.781289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:17.791284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 276/549] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:17.797011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:17.840490 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e0707-b32f-48bf-b435-abaea426d701 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:17.888172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:17.888825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:17.889127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:17.889720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:17.915614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:17.917115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:17.937501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:17.947800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:17.949020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:17.949942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:17.949942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:17.949942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:17.949942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 274/550] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:17.957996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:17.995608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:18.006086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fabf31-6f83-4474-a064-dec9f8979b19 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:18.042226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:18.042857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.043132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.043559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.055337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:18.056791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:18.072984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:18.073973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:18.075015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:18.075015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:18.075015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:18.077228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 277/551] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:18.080201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:18.188702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236202-8837-4426-abb7-48e27b7c729e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:18.226290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:18.226925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.227207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.227481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.228131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:18.228436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:18.229831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:18.239493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:18.248338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 278/552] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:18.249756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:18.283882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db395986-c296-44ac-962f-f7ba2e7b9031 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:18.354560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72435e-a56f-42d8-a0a8-31c28317bad8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:18.356628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:18.357284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.357561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.357831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.358488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:18.358786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:18.360172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:18.390005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:18.390721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.391009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.391284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.391384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 275/553] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:18.398112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:18.399286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:18.400935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:18.414870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:18.415912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:18.416840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:18.420690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 279/554] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:06:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:18.421928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:18.487032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:18.529492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dee31b-3097-4bbc-96be-ed20e2ef8877 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:18.565873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:18.566958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.567240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.567508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.568247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:18.568649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:18.570381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:18.578135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:18.599346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 280/555] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:06:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:18.605060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:18.654775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f0080-61cf-441c-a102-070ab555fd0b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:18.696699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8232a5-d60a-448b-a72a-617f872f47f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:18.697754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8232a5-d60a-448b-a72a-617f872f47f9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.698162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8232a5-d60a-448b-a72a-617f872f47f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.698563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8232a5-d60a-448b-a72a-617f872f47f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.708818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8232a5-d60a-448b-a72a-617f872f47f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:18.710305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8232a5-d60a-448b-a72a-617f872f47f9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6c8232a5-d60a-448b-a72a-617f872f47f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:18.727943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:18.729409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:18.730884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 276/556] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:18.737264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb011b-2a96-4a84-96ba-d7e91949795d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.737264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb011b-2a96-4a84-96ba-d7e91949795d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.737264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb011b-2a96-4a84-96ba-d7e91949795d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.737264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 277/557] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:18.737264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb011b-2a96-4a84-96ba-d7e91949795d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:18.740789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fca509-5811-46c7-b1c3-5a3ba398623c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:18.757373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:18.781167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a8746-30ce-4a24-a1eb-904532d290b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:18.781830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8746-30ce-4a24-a1eb-904532d290b7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.782110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8746-30ce-4a24-a1eb-904532d290b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.782406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a8746-30ce-4a24-a1eb-904532d290b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.793021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a8746-30ce-4a24-a1eb-904532d290b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:18.794496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a8746-30ce-4a24-a1eb-904532d290b7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-2d7a8746-30ce-4a24-a1eb-904532d290b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:18.809953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:18.811065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:18.811973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:18.811973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:18.811973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:18.815852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 281/558] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:18.817249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ffb4-dd82-4cb7-a78d-a6a56ecc51d2 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.817534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ffb4-dd82-4cb7-a78d-a6a56ecc51d2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.817807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30ffb4-dd82-4cb7-a78d-a6a56ecc51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.836687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4d30ffb4-dd82-4cb7-a78d-a6a56ecc51d2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:18.837979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4d30ffb4-dd82-4cb7-a78d-a6a56ecc51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:18.878754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb011b-2a96-4a84-96ba-d7e91949795d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:18.901507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:18.922470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0c40d-d91f-4adc-bbb3-a93661b5ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:18.923089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c40d-d91f-4adc-bbb3-a93661b5ba5f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.923365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c40d-d91f-4adc-bbb3-a93661b5ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.923631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c40d-d91f-4adc-bbb3-a93661b5ba5f None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.924363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0c40d-d91f-4adc-bbb3-a93661b5ba5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:18.924669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0c40d-d91f-4adc-bbb3-a93661b5ba5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:18.926218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0c40d-d91f-4adc-bbb3-a93661b5ba5f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:18.927427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 282/559] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:18.928561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30ffb4-dd82-4cb7-a78d-a6a56ecc51d2 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:18.969011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 278/560] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 31 05:06:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:18.970320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a353-d8b0-4de5-80a8-61dd849d5263 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:18.970608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a353-d8b0-4de5-80a8-61dd849d5263 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:18.970883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a353-d8b0-4de5-80a8-61dd849d5263 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:18.975308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 279/561] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:18.975789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a353-d8b0-4de5-80a8-61dd849d5263 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.034034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:19.041788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30ffb4-dd82-4cb7-a78d-a6a56ecc51d2 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.080994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7f6d1-3075-4157-929e-f7cde78abfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.082123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f6d1-3075-4157-929e-f7cde78abfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.082607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f6d1-3075-4157-929e-f7cde78abfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.083075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7f6d1-3075-4157-929e-f7cde78abfd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.083937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7f6d1-3075-4157-929e-f7cde78abfd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:19.084439 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7f6d1-3075-4157-929e-f7cde78abfd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:19.086122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7f6d1-3075-4157-929e-f7cde78abfd7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:19.099240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 283/562] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:19.100889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583dd2-a711-43f1-bd7e-48782d1a46f2 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.101419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583dd2-a711-43f1-bd7e-48782d1a46f2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.101894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583dd2-a711-43f1-bd7e-48782d1a46f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.111473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a353-d8b0-4de5-80a8-61dd849d5263 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.121904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-82583dd2-a711-43f1-bd7e-48782d1a46f2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:19.123643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-82583dd2-a711-43f1-bd7e-48782d1a46f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:19.155939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e7183-3976-4b21-8721-1883b7d27547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.156775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7183-3976-4b21-8721-1883b7d27547 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.157051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7183-3976-4b21-8721-1883b7d27547 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.157346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7183-3976-4b21-8721-1883b7d27547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.199536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 284/563] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:19.201051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82583dd2-a711-43f1-bd7e-48782d1a46f2 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.225784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:19.250738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e7183-3976-4b21-8721-1883b7d27547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:19.252627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e7183-3976-4b21-8721-1883b7d27547 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:19.301020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:19.317012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82583dd2-a711-43f1-bd7e-48782d1a46f2 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.355057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.355972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.356260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.356531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.362447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 280/564] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:19.363038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:19.364053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbb844-bd44-4882-88fe-13ea2c21cc11 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.364341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbb844-bd44-4882-88fe-13ea2c21cc11 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.364440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:19.364613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbb844-bd44-4882-88fe-13ea2c21cc11 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.366020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 281/565] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:19.366639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbb844-bd44-4882-88fe-13ea2c21cc11 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:19.380512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:19.381509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:19.382436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 285/566] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:19.382949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.454918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:19.482514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbb844-bd44-4882-88fe-13ea2c21cc11 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.488710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc8c2f-2460-4b9a-9c55-7575f36af455 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.516701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bdd4e-4d3d-40e3-b288-579a931dbc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.517354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bdd4e-4d3d-40e3-b288-579a931dbc48 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.517627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bdd4e-4d3d-40e3-b288-579a931dbc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.517896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bdd4e-4d3d-40e3-b288-579a931dbc48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.522616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.523248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.523578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.523792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.528064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bdd4e-4d3d-40e3-b288-579a931dbc48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-586bdd4e-4d3d-40e3-b288-579a931dbc48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:19.532755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:19.533744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:19.534629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:19.535792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:19.535867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 282/567] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:19.535867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5020654-985f-4a59-94c9-823d59e5de14 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.535992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:19.536061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5020654-985f-4a59-94c9-823d59e5de14 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.536061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5020654-985f-4a59-94c9-823d59e5de14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.544376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:19.553274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d5020654-985f-4a59-94c9-823d59e5de14 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:19.553489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:19.554559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:19.555879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:19.555879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:19.555879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:19.556106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d5020654-985f-4a59-94c9-823d59e5de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:19.557244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 286/568] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:19.558069 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.624711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 283/569] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:19.629446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5020654-985f-4a59-94c9-823d59e5de14 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.675010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a89cf-0e2e-49b1-b06a-3c5d75cce2ec None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.699533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:19.707987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.708594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.708863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.709166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.709862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:19.710163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:19.711606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:19.728059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 287/570] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:19.728059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.742586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5020654-985f-4a59-94c9-823d59e5de14 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.780450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e987f-9be4-4b01-9120-415767804d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.781208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e987f-9be4-4b01-9120-415767804d19 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.781486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e987f-9be4-4b01-9120-415767804d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.781737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e987f-9be4-4b01-9120-415767804d19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.783208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:19.794750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e987f-9be4-4b01-9120-415767804d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-182e987f-9be4-4b01-9120-415767804d19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:19.800070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:19.801270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 284/571] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:19.802242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e987f-9be4-4b01-9120-415767804d19 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.831712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb1333-fe9d-4571-bedd-c083714b2b65 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.870900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.871501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.871775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.872042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.872703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:19.873005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:19.874400 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:19.882858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 288/572] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:19.883712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.909558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e987f-9be4-4b01-9120-415767804d19 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:19.934696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:19.943554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:19.944176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:19.944451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:19.944718 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:19.945398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:19.945699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:19.947077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:19.959254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 285/573] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:19.960065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:19.986042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d69c62-7580-4071-9a98-f54d63978d64 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.005937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:20.020791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed69fd-ea21-4030-8ffc-7303edec20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.021482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed69fd-ea21-4030-8ffc-7303edec20cb None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.021757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed69fd-ea21-4030-8ffc-7303edec20cb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.022026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed69fd-ea21-4030-8ffc-7303edec20cb None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/7f5576a90945429a9127a2d4c53a729c/roles/852dcf3bc03949d1990e9200addd3104` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.038417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed69fd-ea21-4030-8ffc-7303edec20cb None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=7f5576a90945429a9127a2d4c53a729c, role_id=852dcf3bc03949d1990e9200addd3104)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.040151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed69fd-ea21-4030-8ffc-7303edec20cb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.052578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 289/574] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:06:19 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/7f5576a90945429a9127a2d4c53a729c/roles/852dcf3bc03949d1990e9200addd3104 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:06:20.053405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed69fd-ea21-4030-8ffc-7303edec20cb None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.060556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9af84-f978-4469-aed5-26e0a2706817 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.100354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.101123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.101425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.101773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.102468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:20.102774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.104336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.114133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 286/575] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:20.114857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.170866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:20.188963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed69fd-ea21-4030-8ffc-7303edec20cb None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.232155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8d482-74a9-448f-886c-a5a9836e3e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.232792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d482-74a9-448f-886c-a5a9836e3e6e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.233057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d482-74a9-448f-886c-a5a9836e3e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.233392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8d482-74a9-448f-886c-a5a9836e3e6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.234033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c3a1f-976f-4e6d-9341-3fe726c42c5f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.244835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8d482-74a9-448f-886c-a5a9836e3e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-60a8d482-74a9-448f-886c-a5a9836e3e6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:20.249698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:20.250665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:20.251533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 290/576] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:20.252280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8d482-74a9-448f-886c-a5a9836e3e6e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.276657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.277328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.277609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.277882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.284331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:20.288986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.290473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:20.305481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:20.306508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:20.307444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:20.307444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:20.307444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:20.307444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 287/577] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:20.307444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.365175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8d482-74a9-448f-886c-a5a9836e3e6e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.401921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.402554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.402832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.403097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.410603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.412131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.414421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f85221-42e2-484a-b33f-3c3cac39d7f0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.416086 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:20.425024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:20.426031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 291/578] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:20.426960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.459332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.459972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.460252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.460525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.471184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.472703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:20.487644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:20.488759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:20.489803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:20.489803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:20.489803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:20.489803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 288/579] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:20.489803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.534205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:20.545021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874aed6-3b67-4974-8d2e-1921d22c6071 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.579604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.580196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.580475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.580749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.581463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:20.581829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.583187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.591399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 292/580] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:20.592205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.619023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c7a89-de76-4e71-a541-18b9a47f6690 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.663270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.663894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.664191 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.664455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.665266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:20.665572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.667215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.680881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 289/581] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:20.681742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.697917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:20.717336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c7213-e5ac-4100-a579-a011858e3c42 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.751096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.751707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.751988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.752259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.752952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:20.753287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.754889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.767286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 293/582] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:20.768080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.782625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:20.795720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32266ad3-9a12-425d-b839-88be5d4c4d20 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.834036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.834649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.834920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.835188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.835826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:20.836123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.837531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.849573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 290/583] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:20.854766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.875507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ef0ca-6a10-412e-8eaa-3a8b7e7c68ed None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:20.911529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:20.912180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:20.912446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:20.912768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:20.923665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:20.925302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:20.934597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:20.943719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:20.944886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:20.945860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:20.945860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:20.945860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:20.945860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 294/584] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:20.945860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:20.965762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9af7-07ee-4a15-be53-6c4d27084f91 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.003798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.004441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.004728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.004995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.009632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:21.014122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.016364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:21.027643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:21.028709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 291/585] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:21.029765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.057704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727573d-f30c-43c8-8984-217688554a6f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.093247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.094005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.094587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.094871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.095756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=2a9e63804d3340b09aa7a3b0e7e8f2d1) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:21.096067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.097632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.103190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 295/586] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:20 2022] GET /identity/v3/role_assignments?user.id=2a9e63804d3340b09aa7a3b0e7e8f2d1&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:21.103980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.157171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817eebe-c90f-4ecf-a1f0-511a17008dbd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.207365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.208054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.208330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.208602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.211551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:21.222171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.224227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.225735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576656-1caf-425d-a14e-17e9b9326b09 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:21.236605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:21.237705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 05:06:21.238904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:21.241738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 292/587] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:21.242855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.262920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:21.276054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.277235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.277235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.277235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.277920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:21.278135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.281136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.298608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 296/588] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:21.299472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.361580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061db255-7a12-430e-9c0e-fbfe9e3e488d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.398615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.399595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.400070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.400649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.401770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:21.402273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.403960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.426930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a95c09-c02a-43b1-8caa-4769c37c58e5 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.431767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 293/589] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:21.433748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.479755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.480417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.480698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.480967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.482079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:21.482383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.484744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.506798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:21.511723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 297/590] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:21.511723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.564903 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:21.584499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d559f-c7bd-4acf-bbc7-7509771a9051 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.632815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.633968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.634712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.635228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.645923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2685b2-7bee-42a0-8159-ad01eac832e7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.646102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.648051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:21.664748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:21.665779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 05:06:21.666738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:21.672513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 294/591] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:21.672513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.694838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.695393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.695665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.695928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.708541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.713348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:21.731259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:21.732469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:21.733575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:21.733575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:21.733575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:21.739779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 298/592] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:21.741366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.818788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94d02-a81f-4ecf-b298-bd1e62d33b46 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.836088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:21.855216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:21.860076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef416278-25bf-4007-9433-55329616ebb1 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:21.866169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.867106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.867727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.868219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.883319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.885623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.898266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:21.898878 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:21.899153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:21.899423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:21.900147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:21.900449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:21.901918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:21.908417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:21.909412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:21.910544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:21.910544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:21.910544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:21.910544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 295/593] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:21.910803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:21.931152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 299/594] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:21.932341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.028269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60121b8c-6569-4b43-b3c4-1879c80fd683 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.044670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9157e4-3c0b-4faf-bd20-5e47ecd1ac5d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.063059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.063679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.063967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.064244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.064896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:22.065232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.066833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.079076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 296/595] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:22.079958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.092152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77df1b-41c0-4ee6-a119-347e3ffecd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.093490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77df1b-41c0-4ee6-a119-347e3ffecd76 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.093915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77df1b-41c0-4ee6-a119-347e3ffecd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.094324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77df1b-41c0-4ee6-a119-347e3ffecd76 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.095454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77df1b-41c0-4ee6-a119-347e3ffecd76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:22.095917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77df1b-41c0-4ee6-a119-347e3ffecd76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.098074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77df1b-41c0-4ee6-a119-347e3ffecd76 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.110787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:22.115626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 300/596] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:22.115626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0d93c-7a7c-4289-9194-2d86bea22959 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.115626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0d93c-7a7c-4289-9194-2d86bea22959 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.115626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0d93c-7a7c-4289-9194-2d86bea22959 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.115963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 301/597] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:22.116388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0d93c-7a7c-4289-9194-2d86bea22959 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.139839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:22.196414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1a0a-0784-42be-8c90-768fdb8b838c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.231294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0d93c-7a7c-4289-9194-2d86bea22959 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.234098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff918-e09b-4a67-9d1a-53122e938e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.234737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff918-e09b-4a67-9d1a-53122e938e63 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.235012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff918-e09b-4a67-9d1a-53122e938e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.235279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff918-e09b-4a67-9d1a-53122e938e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.245660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ff918-e09b-4a67-9d1a-53122e938e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.247195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ff918-e09b-4a67-9d1a-53122e938e63 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-885ff918-e09b-4a67-9d1a-53122e938e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:22.261587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:22.262847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:22.263970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:22.263970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:22.263970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:22.267769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 297/598] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:22.269066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cddb-945f-4bb8-ab07-797caf87d11d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.269371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cddb-945f-4bb8-ab07-797caf87d11d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.269640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cddb-945f-4bb8-ab07-797caf87d11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.269736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.270359 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.270638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.270908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.278107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.279599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.287623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-58d6cddb-945f-4bb8-ab07-797caf87d11d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:22.288812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-58d6cddb-945f-4bb8-ab07-797caf87d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:22.291032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:22.291912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:22.292829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 302/599] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:22.294946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.373110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 298/600] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:22.373110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6cddb-945f-4bb8-ab07-797caf87d11d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.373110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:22.391448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:22.429930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99eb24-4f96-411f-bc61-3155d60ec476 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.480289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.480289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.480289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.480289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.480742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6cddb-945f-4bb8-ab07-797caf87d11d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.495181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.496905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:22.509636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:22.510613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:22.511570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:22.511570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:22.511570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:22.511570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:22.511570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:22.511570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:22.511570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:22.511570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:22.513998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 303/601] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:22.515299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.531422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.531990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.532273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.532599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.533297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:22.533604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.536056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.552638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 299/602] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:22.553524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.628439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:22.645426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e6ba-5032-46f4-8ec5-32cec87b85da None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.675836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466c6d6-93b4-45ca-a2f4-b283eb8672ac None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.682019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.682700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.682985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.683264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.683969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:22.684277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.685733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.688247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:22.702889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 304/603] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:22.702889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.720929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.721697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.722134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.722569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.723429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:22.724047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.725721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.748325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 300/604] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:22.748325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.806742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289e4a4-79af-4d93-803f-5bf64e5041a7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.841037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.841691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.841970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.842241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.849024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:22.850479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:22.856537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b11b2d-ab82-4b08-ac3b-82b30c03f569 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:22.861504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:22.862416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:22.863405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 305/605] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:22.863947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.887330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:22.897380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab471de-ced0-466b-b9ad-8d709d364ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:22.898030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab471de-ced0-466b-b9ad-8d709d364ced None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:22.898300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab471de-ced0-466b-b9ad-8d709d364ced None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:22.898569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab471de-ced0-466b-b9ad-8d709d364ced None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:22.909526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab471de-ced0-466b-b9ad-8d709d364ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cab471de-ced0-466b-b9ad-8d709d364ced None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:22.914549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:22.915533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:22.916491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:22.920496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 301/606] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:22.921351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab471de-ced0-466b-b9ad-8d709d364ced None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:22.929156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:22.977483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea276f2b-b070-4ca3-b875-e7da0b76660f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:23.015297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52766783-ac3c-475f-95e0-dd64b02c0b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:23.015962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766783-ac3c-475f-95e0-dd64b02c0b34 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.016240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766783-ac3c-475f-95e0-dd64b02c0b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.016513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52766783-ac3c-475f-95e0-dd64b02c0b34 None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/75e27abf26954289b3fcffa332e155a4/roles/852dcf3bc03949d1990e9200addd3104` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.027517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab471de-ced0-466b-b9ad-8d709d364ced None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:23.031505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52766783-ac3c-475f-95e0-dd64b02c0b34 None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=75e27abf26954289b3fcffa332e155a4, role_id=852dcf3bc03949d1990e9200addd3104)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:23.032956 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52766783-ac3c-475f-95e0-dd64b02c0b34 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:23.046612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 306/607] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:06:22 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/75e27abf26954289b3fcffa332e155a4/roles/852dcf3bc03949d1990e9200addd3104 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:06:23.047462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52766783-ac3c-475f-95e0-dd64b02c0b34 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:23.065434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01622ac-5a48-4d50-82e7-d5da2d9f929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:23.066202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01622ac-5a48-4d50-82e7-d5da2d9f929f None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.066485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01622ac-5a48-4d50-82e7-d5da2d9f929f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.066775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01622ac-5a48-4d50-82e7-d5da2d9f929f None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/24f45db0ea864a3299cccd7a74b7271b/roles/852dcf3bc03949d1990e9200addd3104` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.084912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01622ac-5a48-4d50-82e7-d5da2d9f929f None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=24f45db0ea864a3299cccd7a74b7271b, role_id=852dcf3bc03949d1990e9200addd3104)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:23.086549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01622ac-5a48-4d50-82e7-d5da2d9f929f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:23.113118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 302/608] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:06:22 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/24f45db0ea864a3299cccd7a74b7271b/roles/852dcf3bc03949d1990e9200addd3104 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:06:23.113118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01622ac-5a48-4d50-82e7-d5da2d9f929f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:23.155678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:23.207005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52766783-ac3c-475f-95e0-dd64b02c0b34 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:23.218223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:23.243689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01622ac-5a48-4d50-82e7-d5da2d9f929f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:23.260674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c194a-b3e2-4519-b007-483b74b901dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:23.261384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c194a-b3e2-4519-b007-483b74b901dc None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.261911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c194a-b3e2-4519-b007-483b74b901dc None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.262183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c194a-b3e2-4519-b007-483b74b901dc None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.263418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c194a-b3e2-4519-b007-483b74b901dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:23.263989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c194a-b3e2-4519-b007-483b74b901dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:23.266136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c194a-b3e2-4519-b007-483b74b901dc None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:23.282359 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 307/609] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:23.283648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46153d2f-92bf-4fff-86ae-d2acfb07a7c1 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.283962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46153d2f-92bf-4fff-86ae-d2acfb07a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.284212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46153d2f-92bf-4fff-86ae-d2acfb07a7c1 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.287656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 308/610] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:23.288316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62895e-c2e6-4d74-a424-c2d5c51956fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:23.289199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62895e-c2e6-4d74-a424-c2d5c51956fb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.289690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62895e-c2e6-4d74-a424-c2d5c51956fb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.290170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62895e-c2e6-4d74-a424-c2d5c51956fb None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.290417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46153d2f-92bf-4fff-86ae-d2acfb07a7c1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:23.291409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62895e-c2e6-4d74-a424-c2d5c51956fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:23.292127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62895e-c2e6-4d74-a424-c2d5c51956fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:23.293945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62895e-c2e6-4d74-a424-c2d5c51956fb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:23.304823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 303/611] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:23.311085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651947c-a219-498f-bb73-72a6ffef54f9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.311334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651947c-a219-498f-bb73-72a6ffef54f9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.311612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651947c-a219-498f-bb73-72a6ffef54f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.331304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7651947c-a219-498f-bb73-72a6ffef54f9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:23.332783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7651947c-a219-498f-bb73-72a6ffef54f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:23.421110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 304/612] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:23.421110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651947c-a219-498f-bb73-72a6ffef54f9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:23.422155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46153d2f-92bf-4fff-86ae-d2acfb07a7c1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:23.445184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:23.489858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22879e-d9e1-40f6-af30-31818a7fd74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:23.490835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22879e-d9e1-40f6-af30-31818a7fd74b None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.491260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22879e-d9e1-40f6-af30-31818a7fd74b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.491674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22879e-d9e1-40f6-af30-31818a7fd74b None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/45dadcdc0903427ca598dcd0bf06a6ca/roles/852dcf3bc03949d1990e9200addd3104` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.518669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22879e-d9e1-40f6-af30-31818a7fd74b None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=45dadcdc0903427ca598dcd0bf06a6ca, role_id=852dcf3bc03949d1990e9200addd3104)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:23.521205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22879e-d9e1-40f6-af30-31818a7fd74b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:23.533110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651947c-a219-498f-bb73-72a6ffef54f9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:23.548174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 309/613] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:06:23 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/45dadcdc0903427ca598dcd0bf06a6ca/roles/852dcf3bc03949d1990e9200addd3104 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:06:23.593339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:23.593997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.594283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.594554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.618121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:23.619610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:23.643457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:23.644804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:23.646014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:23.646014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:23.646014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:23.646014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 305/614] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:23.650809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22879e-d9e1-40f6-af30-31818a7fd74b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:23.693764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:23.808291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22879e-d9e1-40f6-af30-31818a7fd74b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:23.842195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:23.842802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:23.843078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:23.843403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:23.844024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:23.844295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:23.845742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:23.855496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:23.862258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 310/615] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:23.866376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:23.953651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:23.972082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644802b-f989-451a-84ba-2fa90a903555 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:24.006091 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:24.006462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8722f-2c4a-4b00-ac93-002cdd9cdb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:24.007105 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8722f-2c4a-4b00-ac93-002cdd9cdb31 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:24.008233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8722f-2c4a-4b00-ac93-002cdd9cdb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:24.008233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8722f-2c4a-4b00-ac93-002cdd9cdb31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:24.019558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8722f-2c4a-4b00-ac93-002cdd9cdb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9ad8722f-2c4a-4b00-ac93-002cdd9cdb31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:24.025551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:24.026690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:24.027724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:24.029874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 306/616] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:24.038347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8722f-2c4a-4b00-ac93-002cdd9cdb31 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:24.058175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21798648-a880-4393-97ea-d4aa8c8c66a6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:24.121286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:24.121849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:24.122128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:24.122494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:24.133119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:24.133751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:24.145882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:24.147053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:24.148323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:24.149424 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 311/617] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:06:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:24.155067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:24.215222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8722f-2c4a-4b00-ac93-002cdd9cdb31 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:24.284480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:24.286085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:24.286437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:24.286900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:24.289360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:24.289984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:24.291759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:24.314384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 307/618] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:24.320155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:24.325288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:24.329961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be0d8d-7702-4ca5-ac8e-ba85140a5867 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:24.366099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:24.366729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:24.367006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:24.367320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:24.368064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:24.368368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:24.369835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:24.372730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:24.389767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 312/619] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:06:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:24.397729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:24.510005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d73d08-9802-4830-b679-ca69342db0f0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:24.563506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018b9ee-673e-4812-b3b7-9a40b6b4ef2a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:24.582893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:24.583535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:24.583815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:24.584096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:24.606687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:24.608304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:24.636703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a23fca-6717-41f0-9d6f-dd2531e764a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:24.637355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a23fca-6717-41f0-9d6f-dd2531e764a9 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:24.637636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a23fca-6717-41f0-9d6f-dd2531e764a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:24.637909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a23fca-6717-41f0-9d6f-dd2531e764a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:24.647462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:24.648659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:24.649835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:24.649835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:24.649835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:24.650064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 308/620] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:24.655863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:24.757900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:24.760864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:24.771426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a23fca-6717-41f0-9d6f-dd2531e764a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:24.773817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a23fca-6717-41f0-9d6f-dd2531e764a9 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:24.821728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741e9de-a27e-4ed3-9149-e737f2488729 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:24.891934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:24.892466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:24.892744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:24.893014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:24.893701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:24.898942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:24.900449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:24.918683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 309/621] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:24.927922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:24.971874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 313/622] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:24.977818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a23fca-6717-41f0-9d6f-dd2531e764a9 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.041303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2998b3-bf6a-4a97-aab9-93c9b9f8612b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:25.056769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:25.085980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:25.087013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.087495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.087962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.097902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:25.100324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:25.129581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:25.130636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:25.131632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:25.135630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 310/623] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:25.142063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.167829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:25.181947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a23fca-6717-41f0-9d6f-dd2531e764a9 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:25.230595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d7c4a-9582-4714-a8ac-4b149dde2f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:25.231283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7c4a-9582-4714-a8ac-4b149dde2f7b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.231569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7c4a-9582-4714-a8ac-4b149dde2f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.231840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d7c4a-9582-4714-a8ac-4b149dde2f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.245421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d7c4a-9582-4714-a8ac-4b149dde2f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:25.246881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d7c4a-9582-4714-a8ac-4b149dde2f7b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-484d7c4a-9582-4714-a8ac-4b149dde2f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:25.265962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:25.267000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:25.267951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:25.267951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:25.267951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:25.267951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 314/624] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:25.268652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884db741-6991-4a46-8de7-a5252322948c None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.268937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884db741-6991-4a46-8de7-a5252322948c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.273342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884db741-6991-4a46-8de7-a5252322948c None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.274921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 315/625] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:25.276798 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884db741-6991-4a46-8de7-a5252322948c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.304420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bad74d-be93-4b89-9436-43c037902667 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:25.341836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37765d8-2c5e-4813-aa34-db709e7b406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:25.342597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37765d8-2c5e-4813-aa34-db709e7b406c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.342878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37765d8-2c5e-4813-aa34-db709e7b406c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.343154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37765d8-2c5e-4813-aa34-db709e7b406c None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.343971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37765d8-2c5e-4813-aa34-db709e7b406c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:25.344290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37765d8-2c5e-4813-aa34-db709e7b406c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:25.345887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37765d8-2c5e-4813-aa34-db709e7b406c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:25.365739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 311/626] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 31 05:06:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:25.367232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831955c2-ddc0-4618-a13b-d23318807e3c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.367496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831955c2-ddc0-4618-a13b-d23318807e3c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.367769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831955c2-ddc0-4618-a13b-d23318807e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.386572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-831955c2-ddc0-4618-a13b-d23318807e3c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:25.387782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-831955c2-ddc0-4618-a13b-d23318807e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:25.389179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884db741-6991-4a46-8de7-a5252322948c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:25.416092 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:25.430091 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ba072-8936-4638-b206-3d6b201dbfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:25.430995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba072-8936-4638-b206-3d6b201dbfdd None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.431456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba072-8936-4638-b206-3d6b201dbfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.432325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ba072-8936-4638-b206-3d6b201dbfdd None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.433235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ba072-8936-4638-b206-3d6b201dbfdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:25.433722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ba072-8936-4638-b206-3d6b201dbfdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:25.435933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ba072-8936-4638-b206-3d6b201dbfdd None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:25.451902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 316/627] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:25.453785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb49fc-9d5c-4d4f-a794-10601105037b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.454535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb49fc-9d5c-4d4f-a794-10601105037b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.455092 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb49fc-9d5c-4d4f-a794-10601105037b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.456613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 317/628] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:25.457501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb49fc-9d5c-4d4f-a794-10601105037b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.469067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 312/629] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:25.469067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831955c2-ddc0-4618-a13b-d23318807e3c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.477596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:25.578393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb49fc-9d5c-4d4f-a794-10601105037b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:25.593237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831955c2-ddc0-4618-a13b-d23318807e3c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:25.619694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ea1b-f57b-4311-8305-5cd6b41c867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:25.620896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ea1b-f57b-4311-8305-5cd6b41c867b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.621418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ea1b-f57b-4311-8305-5cd6b41c867b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.622032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ea1b-f57b-4311-8305-5cd6b41c867b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.635210 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ea1b-f57b-4311-8305-5cd6b41c867b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:25.635643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:25.636533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.637078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.637630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.638314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33ea1b-f57b-4311-8305-5cd6b41c867b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:25.646883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:25.648809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-5e33ea1b-f57b-4311-8305-5cd6b41c867b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:25.657546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:25.658541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:25.659495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:25.659495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:25.659495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:25.661729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 318/630] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:25.663514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113ca9-7ecf-4585-80b0-34b7bce5e783 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.664026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113ca9-7ecf-4585-80b0-34b7bce5e783 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.664495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113ca9-7ecf-4585-80b0-34b7bce5e783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:25.666586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:25.667682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:25.668606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 313/631] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:25.669159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.692445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-87113ca9-7ecf-4585-80b0-34b7bce5e783 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:25.694370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-87113ca9-7ecf-4585-80b0-34b7bce5e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:25.699635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:25.755806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:25.772039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 319/632] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:25.773027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113ca9-7ecf-4585-80b0-34b7bce5e783 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.810243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c2b1b-52d5-4b90-860d-860d03a798b3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:25.848041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:25.848658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.848935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.849235 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.849883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:25.850185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:25.851556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:25.867826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 314/633] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:25.868727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.905019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113ca9-7ecf-4585-80b0-34b7bce5e783 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:25.948774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:25.949728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:25.950204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:25.950674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:25.951913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:25.952535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:25.955039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:25.968109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 320/634] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:25.973132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:25.973651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:25.994920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfeaeaa-8946-4a81-9a2c-d3301a208486 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.026455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:26.030482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b83a08-aa3a-4977-adcf-415b3ef428dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.031305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b83a08-aa3a-4977-adcf-415b3ef428dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.031711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b83a08-aa3a-4977-adcf-415b3ef428dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.032128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b83a08-aa3a-4977-adcf-415b3ef428dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.043487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b83a08-aa3a-4977-adcf-415b3ef428dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b1b83a08-aa3a-4977-adcf-415b3ef428dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:26.048762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:26.049747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:26.050666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 315/635] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:26.052003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d360-e71a-4ac6-9f0f-cc1bfef08148 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.052003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d360-e71a-4ac6-9f0f-cc1bfef08148 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.052174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d360-e71a-4ac6-9f0f-cc1bfef08148 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.053424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 316/636] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:26.053986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d360-e71a-4ac6-9f0f-cc1bfef08148 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.101128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe784ee-942d-4c48-95c1-2881eabe823b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.146686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.147335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.147616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.147900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.156668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:26.158998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:26.171113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d360-e71a-4ac6-9f0f-cc1bfef08148 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:26.174708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:26.175940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:26.176928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:26.176928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:26.176928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:26.176928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:26.176928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:26.176928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:26.176928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:26.176928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:26.181249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 321/637] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:26.181996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.210131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670b63-d3f7-429a-bd57-ba4359dce9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.210667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670b63-d3f7-429a-bd57-ba4359dce9eb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.210951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670b63-d3f7-429a-bd57-ba4359dce9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.211220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670b63-d3f7-429a-bd57-ba4359dce9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.211985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670b63-d3f7-429a-bd57-ba4359dce9eb None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=7f5576a90945429a9127a2d4c53a729c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:26.212248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670b63-d3f7-429a-bd57-ba4359dce9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:26.213740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670b63-d3f7-429a-bd57-ba4359dce9eb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:26.220461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 317/638] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/role_assignments?user.id=7f5576a90945429a9127a2d4c53a729c&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:26.221926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815ef2-648d-4a7e-917c-58dc5d9f5079 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.222428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815ef2-648d-4a7e-917c-58dc5d9f5079 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.223090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815ef2-648d-4a7e-917c-58dc5d9f5079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.237060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:26.247651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-24815ef2-648d-4a7e-917c-58dc5d9f5079 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:26.248893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-24815ef2-648d-4a7e-917c-58dc5d9f5079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:26.310909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91216d4-4cf9-4ed1-8cb4-fb04a2b9dfea None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.321593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:26.341528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 318/639] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:26.342543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815ef2-648d-4a7e-917c-58dc5d9f5079 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.375548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.376161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.376437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.376705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.377879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:26.378270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:26.380147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:26.396024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 322/640] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:26.396024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.499085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815ef2-648d-4a7e-917c-58dc5d9f5079 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.537859 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2662-31d3-40e4-b723-a086437e9475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.538325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ddfce-59cd-41fe-966e-1cd0f247766a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.538942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2662-31d3-40e4-b723-a086437e9475 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.539359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2662-31d3-40e4-b723-a086437e9475 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.539866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df2662-31d3-40e4-b723-a086437e9475 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.543326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:26.553687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df2662-31d3-40e4-b723-a086437e9475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-43df2662-31d3-40e4-b723-a086437e9475 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:26.559189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:26.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:26.561381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:26.562324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 319/641] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:26.563129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2662-31d3-40e4-b723-a086437e9475 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.583907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.585275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.585999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.586448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.587585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:26.588080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:26.590463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:26.608616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 323/642] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:26.609802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.649149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:26.689538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df2662-31d3-40e4-b723-a086437e9475 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.724841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd864f-30bb-44b5-b808-1482854c2eac None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.726321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.726952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.727224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.727495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.737942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:26.739375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:26.754944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:26.756000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:26.757312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:26.757312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:26.757312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:26.757312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 320/643] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:26.757312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.766656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.767272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.767548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.767816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.768476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:26.768792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:26.770616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:26.778905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 324/644] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:26.779715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.812529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:26.869892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba6b7b-5d76-403a-8e2d-8f5a78cbacbf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.879169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:26.887850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48bfc2-3484-4c75-ac69-67b6ea8ce427 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:26.907379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9169a9-dcb6-4844-8c62-396a3fdce83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.908047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9169a9-dcb6-4844-8c62-396a3fdce83b None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.908726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9169a9-dcb6-4844-8c62-396a3fdce83b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.909001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9169a9-dcb6-4844-8c62-396a3fdce83b None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/2a9e63804d3340b09aa7a3b0e7e8f2d1/roles/852dcf3bc03949d1990e9200addd3104` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.922201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c58cd-d488-4ea7-a5f1-0606c04e6dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:26.922895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c58cd-d488-4ea7-a5f1-0606c04e6dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:26.923175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c58cd-d488-4ea7-a5f1-0606c04e6dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:26.923444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c58cd-d488-4ea7-a5f1-0606c04e6dd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:26.924524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9169a9-dcb6-4844-8c62-396a3fdce83b None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=2a9e63804d3340b09aa7a3b0e7e8f2d1, role_id=852dcf3bc03949d1990e9200addd3104)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:26.926052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9169a9-dcb6-4844-8c62-396a3fdce83b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:26.934280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c58cd-d488-4ea7-a5f1-0606c04e6dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-de7c58cd-d488-4ea7-a5f1-0606c04e6dd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:26.939611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:26.940694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:26.941750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:26.942437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 321/645] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:06:26 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/2a9e63804d3340b09aa7a3b0e7e8f2d1/roles/852dcf3bc03949d1990e9200addd3104 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:06:26.942518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 325/646] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:26.942588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9169a9-dcb6-4844-8c62-396a3fdce83b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:26.942665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c58cd-d488-4ea7-a5f1-0606c04e6dd0 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.062110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:27.065613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c58cd-d488-4ea7-a5f1-0606c04e6dd0 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.069017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9169a9-dcb6-4844-8c62-396a3fdce83b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.107535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.108146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.108292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.108416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.108677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.109106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.109356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:27.109487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.109653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.109894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.111079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.120988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.123815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.129296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 322/647] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:27.129296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:27.146543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:27.147563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:27.148540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:27.148540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:27.148540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:27.148540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 326/648] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:27.149708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.154034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:27.238815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a8ac0-3059-4278-8fc1-4cb87fc3fd89 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.273709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd19da4-e86a-4a08-9e97-d0b74c67b648 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.285041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.286044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.286333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.286603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.287528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:27.287847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.289255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.300469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 323/649] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:27.301692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.312339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.313316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.313837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.314351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.322960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.324709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.327176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:27.338979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:27.340013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:27.340994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 327/650] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:27.341649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.407024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:27.421720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f1e0e-690f-41fd-995a-ada6e3838d4d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.449773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbfa2-15ec-48c6-8254-71d24df864c5 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.471979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.473142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.473537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.473818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.474487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:27.474796 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.476194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.491286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.492220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.492736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.493273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.496797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 324/651] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:27.498125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.507142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.508899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:27.523942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:27.525022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:27.525971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:27.525971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:27.525971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:27.528093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 328/652] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:27.529191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.592527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:27.613779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d882f8-a232-43d8-aab2-82802aafc903 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.632418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243b572-052a-4238-9a2e-fc8fbd3defed None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.649863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:27.661150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.661779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.662059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.662330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.663066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:27.663370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.665010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.672667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.673639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.674124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.674619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.682811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.684478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 325/653] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:27.684778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.685452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:27.697297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:27.698284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 05:06:27.699264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:27.701728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 329/654] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:27.702715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.799193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700b92c-3fcf-43de-aa75-33b103a8aea5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.806877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbabde-ac45-406a-b396-c9a306f73f81 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:27.837371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.838073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.838359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.838635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.839413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:27.839680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.841182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.844581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619b8cf-094a-42ac-b887-c119fa277662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:27.845516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b8cf-094a-42ac-b887-c119fa277662 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:27.846038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b8cf-094a-42ac-b887-c119fa277662 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:27.846547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b8cf-094a-42ac-b887-c119fa277662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:27.848344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:27.855771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 326/655] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:27.856983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:27.894827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:27.919841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619b8cf-094a-42ac-b887-c119fa277662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:27.921649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619b8cf-094a-42ac-b887-c119fa277662 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:27.967313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c931a-4fa5-4128-a174-d0011357461d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:28.009119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:28.009119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.009119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.009119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.009544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:28.009544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:28.009544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:28.029590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 330/657] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:28.030538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619b8cf-094a-42ac-b887-c119fa277662 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.032716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 327/657] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Aug 31 05:06:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:28.033900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.095994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:28.110125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:28.136763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619b8cf-094a-42ac-b887-c119fa277662 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:28.149278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebadd480-1b85-475a-9a53-a9d5fef4acc1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:28.175070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:28.175985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.176377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.176972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.184305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:28.185896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:28.188456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:28.189303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.189727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.190145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:28.198192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:28.199366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 05:06:28.200647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:28.203972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 331/658] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:28.204633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:28.204864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.206607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:28.222734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:28.223941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:28.225018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:28.225018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:28.225018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:28.226768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 328/659] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:28.227672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.315559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaeaf-c2e0-4e6f-b3bf-cde673e60422 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:28.337460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c29e9-72f6-43e3-80a3-5b5c8ee44659 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:28.347405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:28.352047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066f5bb-2aec-4843-9972-2437b39d8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:28.352656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f5bb-2aec-4843-9972-2437b39d8baf None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.352946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f5bb-2aec-4843-9972-2437b39d8baf None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.353231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f5bb-2aec-4843-9972-2437b39d8baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.357624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:28.374715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:28.375473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.375848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.376213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.377037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:28.377460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:28.379363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:28.402550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 329/660] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:28.403576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.425683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f5bb-2aec-4843-9972-2437b39d8baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:28.427275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f5bb-2aec-4843-9972-2437b39d8baf None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:28.506384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f0c1b-fe08-4f6b-b8fa-010c84e57b2a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:28.538848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 332/661] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:28.538848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dc14b-3fc6-46b4-b245-80a8d240bbba None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.538848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dc14b-3fc6-46b4-b245-80a8d240bbba None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.538848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dc14b-3fc6-46b4-b245-80a8d240bbba None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.538848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 333/662] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:28.538848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dc14b-3fc6-46b4-b245-80a8d240bbba None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.549605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:28.550370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.550871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.551448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.552129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:28.552436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:28.553844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:28.571581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 330/663] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:28.571581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.580616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:28.601100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:28.652853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dc14b-3fc6-46b4-b245-80a8d240bbba None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:28.688440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56906f27-72f7-40e1-b9ee-b1e726b1db6d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:28.689042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54e842-3817-4c30-85b3-cb60ada3f4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:28.689681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e842-3817-4c30-85b3-cb60ada3f4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.689957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e842-3817-4c30-85b3-cb60ada3f4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.690314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e842-3817-4c30-85b3-cb60ada3f4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.725505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baec5c-0d52-4eac-9d5c-bb242576b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:28.726142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baec5c-0d52-4eac-9d5c-bb242576b984 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.726416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baec5c-0d52-4eac-9d5c-bb242576b984 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.726681 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baec5c-0d52-4eac-9d5c-bb242576b984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.737120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baec5c-0d52-4eac-9d5c-bb242576b984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:28.738619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71baec5c-0d52-4eac-9d5c-bb242576b984 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-71baec5c-0d52-4eac-9d5c-bb242576b984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:28.752440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:28.753808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:28.755014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:28.755014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:28.755014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:28.757533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 331/664] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:28.759714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12e3f-7a78-41b5-8e12-de0ecbe03b52 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:28.759995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12e3f-7a78-41b5-8e12-de0ecbe03b52 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:28.760271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12e3f-7a78-41b5-8e12-de0ecbe03b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:28.772255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54e842-3817-4c30-85b3-cb60ada3f4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:28.773850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54e842-3817-4c30-85b3-cb60ada3f4d9 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:28.781259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e0c12e3f-7a78-41b5-8e12-de0ecbe03b52 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:28.782563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e0c12e3f-7a78-41b5-8e12-de0ecbe03b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:28.810896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:28.857224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 332/665] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:28.857224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c12e3f-7a78-41b5-8e12-de0ecbe03b52 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.873421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:28.892473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 334/666] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 05:06:28.893617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54e842-3817-4c30-85b3-cb60ada3f4d9 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:28.985651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c12e3f-7a78-41b5-8e12-de0ecbe03b52 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.000610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54e842-3817-4c30-85b3-cb60ada3f4d9 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.021726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.022430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.022708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.022971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.030026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.031450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.039485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a3cf4-077d-4572-9f35-a9fb0adc99a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.040367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3cf4-077d-4572-9f35-a9fb0adc99a2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.040845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3cf4-077d-4572-9f35-a9fb0adc99a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.041344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3cf4-077d-4572-9f35-a9fb0adc99a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.042211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a3cf4-077d-4572-9f35-a9fb0adc99a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:29.042472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:29.043348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 333/667] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:29.044278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.045669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a3cf4-077d-4572-9f35-a9fb0adc99a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.047138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a3cf4-077d-4572-9f35-a9fb0adc99a2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.050145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:29.065797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 335/668] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:29.065797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982db82b-d598-4e48-b45d-20d86855813e None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.065797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982db82b-d598-4e48-b45d-20d86855813e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.065797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982db82b-d598-4e48-b45d-20d86855813e None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.065797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 336/669] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:29.065797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982db82b-d598-4e48-b45d-20d86855813e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.122112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:29.156578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80352565-dcb1-4172-8300-f76af4a7d74c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.176858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982db82b-d598-4e48-b45d-20d86855813e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.189632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.190276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.190556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.190872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.200996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.202467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.210640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9961b-26d1-4b8b-8484-34417fc8801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.211627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9961b-26d1-4b8b-8484-34417fc8801d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.211909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9961b-26d1-4b8b-8484-34417fc8801d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.212201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9961b-26d1-4b8b-8484-34417fc8801d None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.212896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9961b-26d1-4b8b-8484-34417fc8801d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:29.213238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9961b-26d1-4b8b-8484-34417fc8801d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.214644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9961b-26d1-4b8b-8484-34417fc8801d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:29.216991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:29.218177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:29.219384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:29.219384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:29.219384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:29.222921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 334/670] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:29.223780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.230945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 337/671] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:29.230945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2738f-c0ae-49ee-8bc8-3654e86059de None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.230945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2738f-c0ae-49ee-8bc8-3654e86059de None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.230945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2738f-c0ae-49ee-8bc8-3654e86059de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.245591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d3d2738f-c0ae-49ee-8bc8-3654e86059de None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:29.246783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d3d2738f-c0ae-49ee-8bc8-3654e86059de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:29.297515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:29.314792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 338/672] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:29.315834 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2738f-c0ae-49ee-8bc8-3654e86059de None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.323170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33708ddb-bd22-4636-8c32-3bbbd06a39cc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.344357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:29.363757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.364533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.364923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.365320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.372832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.374429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:29.386300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:29.387448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:29.388624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:29.388624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:29.388624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:29.388624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:29.388624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:29.388624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:29.388624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:29.388624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:29.394878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 335/673] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:29.395533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.438023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2738f-c0ae-49ee-8bc8-3654e86059de None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.480769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c22096-6eda-46c5-b98a-a1f12afad933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.481611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22096-6eda-46c5-b98a-a1f12afad933 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.481948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22096-6eda-46c5-b98a-a1f12afad933 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.482565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22096-6eda-46c5-b98a-a1f12afad933 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.493909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c22096-6eda-46c5-b98a-a1f12afad933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:29.497224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e706a11-9ceb-4b7c-a991-8bd720c02b04 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-c7c22096-6eda-46c5-b98a-a1f12afad933 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:29.499035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:29.500163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:29.501541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 339/674] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:29.502280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c22096-6eda-46c5-b98a-a1f12afad933 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.541938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.542549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.542819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.543551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.544198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:29.544500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.546372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.551133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:29.560760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 336/675] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:29.562208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.606699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c22096-6eda-46c5-b98a-a1f12afad933 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.606897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:29.641499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.642111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.642388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.642660 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.643393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=75e27abf26954289b3fcffa332e155a4) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:29.643699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.645188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.650920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 340/676] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/role_assignments?user.id=75e27abf26954289b3fcffa332e155a4&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:29.651689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.668405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a2fcd-a4a1-4ce1-9c01-7d348cc348e9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.708561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.709411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.709789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.710144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.710870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:29.711172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.712627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.728261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 337/677] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:29.729012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.794320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ae5c7-fe8d-4e3c-8a13-f9b7b04b93e4 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.806401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:29.834840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.835771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.836673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.836673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.837248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:29.837351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.838659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.844205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:29.848262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea89a6-7788-4a29-967b-908cce17628f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.850526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 341/678] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:29.851375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.889170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.890129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.890336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.890655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:29.897602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:29.899057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:29.910571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:29.911487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 338/679] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:29.912448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:29.962383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a89c4-e0c3-4e67-bd98-eea991e65d5b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:29.998219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8f73-cc3c-4379-b420-cdb38eca7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:29.998860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8f73-cc3c-4379-b420-cdb38eca7865 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:29.999119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8f73-cc3c-4379-b420-cdb38eca7865 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:29.999388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8f73-cc3c-4379-b420-cdb38eca7865 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.010250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e8f73-cc3c-4379-b420-cdb38eca7865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-dd7e8f73-cc3c-4379-b420-cdb38eca7865 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:30.015761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:30.016717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:30.017982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:30.018636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b3d7d-5a14-4ebe-a6cf-61d8022191f0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.018711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 342/680] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:30.018711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8f73-cc3c-4379-b420-cdb38eca7865 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.053786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:30.057530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.058201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.058580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.058774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.059471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=24f45db0ea864a3299cccd7a74b7271b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:30.059914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.061222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.068354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 339/681] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:29 2022] GET /identity/v3/role_assignments?user.id=24f45db0ea864a3299cccd7a74b7271b&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:30.070005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.114881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:30.138263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8f73-cc3c-4379-b420-cdb38eca7865 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.183004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.183004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.183004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.183004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.199919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.202601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:30.222492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:30.223624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:30.224681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:30.224681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:30.224681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:30.224681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 343/682] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:30.225422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.227721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab195570-df6b-4a97-bd2e-c2b9f179cde9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.270619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.271563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.271913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.272255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.273022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:30.273436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.274951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.289204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 340/683] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:30.290254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.330780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:30.355466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd724ff-43a4-4c75-948b-fbe36f2cd7ae None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.398745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:30.408461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.409711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.410435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.410905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.412409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:30.412914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.415309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.417420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7e71d-2460-438a-802c-bbc94c938ff3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.426433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 344/684] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:30.428054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.468468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.469004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.469320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.469593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.470485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:30.471630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.473148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.488422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 341/685] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:30.489488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.540553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1726-e910-4080-b659-7605601dce1c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.576432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.577224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.577562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.577898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.578689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=45dadcdc0903427ca598dcd0bf06a6ca) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:30.579060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.580610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.588577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 345/686] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/role_assignments?user.id=45dadcdc0903427ca598dcd0bf06a6ca&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:30.589615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.606767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:30.632491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07209f0d-1403-46ac-9e9b-0bc04b5948dd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.687729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.688391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.688663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.688928 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.713242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9db60e-5750-46c2-931b-5d3492d299aa None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.713606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.714885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.721158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:30.746356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:30.748606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:30.750804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:30.750804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:30.750804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:30.750804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 342/687] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:30.756818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.757317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.757991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.758274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.758547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.774038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.775739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:30.789465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:30.790808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:30.791816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 346/688] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:30.796070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.889148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:30.903651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611b66-1ddd-4c30-b08c-a7963a4d7a11 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.917975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1ba25-5a4e-4bbc-aae7-a6bc4b0033f9 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:30.948760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.949769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.950527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.950906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.951925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:30.952326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.953819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.956788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:30.957132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:30.957436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:30.957752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:30.958484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:30.958788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:30.960194 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:30.969746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 343/689] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:30.976407 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:30.991551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 347/690] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:30.997226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:31.038099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:31.077514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153ad14-80da-494a-8d91-224ff7124347 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:31.113731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:31.114414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.114674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.114946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.122607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:31.124443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:31.136585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:31.137656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:31.138698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 344/691] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:31.143588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:31.230658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed48912-9a33-48eb-bca5-8e3910956c99 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:31.260662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:31.280870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faeb02-ff3e-42ad-850f-3a24a8fef1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:31.281513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faeb02-ff3e-42ad-850f-3a24a8fef1ad None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.281789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faeb02-ff3e-42ad-850f-3a24a8fef1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.282055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faeb02-ff3e-42ad-850f-3a24a8fef1ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.335394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee46d7-5054-4189-8a8a-f24c13e8cebd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:31.352674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:31.372258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:31.372877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.373183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.373457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.374247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:31.374559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:31.376128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:31.379063 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faeb02-ff3e-42ad-850f-3a24a8fef1ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:31.380591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faeb02-ff3e-42ad-850f-3a24a8fef1ad None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:31.396641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 345/692] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 31 05:06:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:31.402112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:31.510232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b1ec1-11e2-4d8d-a33a-f3825df558ef None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:31.527527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 348/693] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 05:06:31.533227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faeb02-ff3e-42ad-850f-3a24a8fef1ad None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:31.546727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efe2e3-8444-4b41-bff3-d1b226728d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:31.547353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe2e3-8444-4b41-bff3-d1b226728d79 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.547633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe2e3-8444-4b41-bff3-d1b226728d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.547903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe2e3-8444-4b41-bff3-d1b226728d79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.562295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:31.601477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:31.623147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efe2e3-8444-4b41-bff3-d1b226728d79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:31.624851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efe2e3-8444-4b41-bff3-d1b226728d79 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:31.668441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faeb02-ff3e-42ad-850f-3a24a8fef1ad None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:31.731666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:31.732354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.732658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.732991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.743799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 346/694] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 05:06:31.748972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:31.749435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efe2e3-8444-4b41-bff3-d1b226728d79 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:31.754735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:31.785707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:31.786677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:31.787597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:31.787597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:31.787597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:31.787597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 349/695] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:31.793657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:31.828650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:31.854526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efe2e3-8444-4b41-bff3-d1b226728d79 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:31.890884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd406a75-4da8-45a5-941b-9e382a254fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:31.891527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406a75-4da8-45a5-941b-9e382a254fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.891805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406a75-4da8-45a5-941b-9e382a254fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.892083 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406a75-4da8-45a5-941b-9e382a254fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.892404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:31.905429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406a75-4da8-45a5-941b-9e382a254fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:31.907681 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406a75-4da8-45a5-941b-9e382a254fe6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:31.912809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec3931-972c-4400-94b0-1d0a2b159e76 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cd406a75-4da8-45a5-941b-9e382a254fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:31.924291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:31.925886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:31.927142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:31.927142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:31.927142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:31.928973 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 347/696] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:31.934885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025930-db67-44b3-90fe-e5a1e65c2a05 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.935357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025930-db67-44b3-90fe-e5a1e65c2a05 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.935808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc025930-db67-44b3-90fe-e5a1e65c2a05 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.937686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 348/697] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:31.938543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025930-db67-44b3-90fe-e5a1e65c2a05 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:31.952045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6400-90f0-4faf-9ca9-f835444b062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:31.952919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6400-90f0-4faf-9ca9-f835444b062a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.953066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6400-90f0-4faf-9ca9-f835444b062a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.953328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6400-90f0-4faf-9ca9-f835444b062a None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.953981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6400-90f0-4faf-9ca9-f835444b062a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:31.954347 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6400-90f0-4faf-9ca9-f835444b062a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:31.955647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6400-90f0-4faf-9ca9-f835444b062a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:31.969009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 350/698] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:31.970498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560992-18b4-45a0-98a1-00ae90f019e4 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:31.970787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560992-18b4-45a0-98a1-00ae90f019e4 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:31.971079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a560992-18b4-45a0-98a1-00ae90f019e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:31.989859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0a560992-18b4-45a0-98a1-00ae90f019e4 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:31.991048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0a560992-18b4-45a0-98a1-00ae90f019e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:32.051890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc025930-db67-44b3-90fe-e5a1e65c2a05 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:32.069217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 351/699] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:32.070282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a560992-18b4-45a0-98a1-00ae90f019e4 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:32.088634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:32.089625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.090111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:32.090583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.091144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.091978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:32.092567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:32.094185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:32.108051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 349/700] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:32.113963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:32.215853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:32.236089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587906-8d02-4293-91fb-b7d4c04d9863 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:32.272756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:32.273833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.274293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.274765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.281947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:32.283757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:32.295236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a560992-18b4-45a0-98a1-00ae90f019e4 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:32.295847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:32.296863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:32.297849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:32.297849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:32.297849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:32.297849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:32.297849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:32.297849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:32.297849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:32.297849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:32.299903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 350/701] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:32.305822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:32.355189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:32.370656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:32.371302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.371576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.371843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.390494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:32.391956 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:32.412600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf505ca-57c1-4989-9f60-a93a47ecceb0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:32.412815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:32.413714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:32.414647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:32.414647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:32.414647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:32.414647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:32.414647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:32.414647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:32.414647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:32.414647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:32.422200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 352/702] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:32.431445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:32.453073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:32.454135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.454640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.455123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.456025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:32.456332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:32.457873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:32.470128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 351/703] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:32.470954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:32.540889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54224cc1-400c-448b-a51a-c2583653b04c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:32.569663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:32.578188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0046e1a-85fe-4a46-8084-20d7707ca21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:32.578801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0046e1a-85fe-4a46-8084-20d7707ca21f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.579073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0046e1a-85fe-4a46-8084-20d7707ca21f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.579339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0046e1a-85fe-4a46-8084-20d7707ca21f None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.579496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358b49-1dee-4bf3-a18e-6d33e19e0857 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:32.580025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0046e1a-85fe-4a46-8084-20d7707ca21f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:32.580330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0046e1a-85fe-4a46-8084-20d7707ca21f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:32.582552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0046e1a-85fe-4a46-8084-20d7707ca21f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:32.587446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:32.600921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 353/704] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:32.600921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8d359-1475-4112-baf4-10649fd40266 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.600921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8d359-1475-4112-baf4-10649fd40266 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.600921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8d359-1475-4112-baf4-10649fd40266 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.600921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 354/705] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:32.600921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8d359-1475-4112-baf4-10649fd40266 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:32.624078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:32.624722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.624988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.625290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.625882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:32.627273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:32.638923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:32.640314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:32.641229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 352/706] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 31 05:06:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:32.642064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:32.734841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8d359-1475-4112-baf4-10649fd40266 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:32.763260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2351c-a68d-4063-ac67-51b9876835ca None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:32.770939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a3480-dc9d-4009-b35a-de3a1fc756c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:32.771544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3480-dc9d-4009-b35a-de3a1fc756c1 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.771823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3480-dc9d-4009-b35a-de3a1fc756c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.772064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a3480-dc9d-4009-b35a-de3a1fc756c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.772792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a3480-dc9d-4009-b35a-de3a1fc756c1 None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=2a9e63804d3340b09aa7a3b0e7e8f2d1) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:32.773106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a3480-dc9d-4009-b35a-de3a1fc756c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:32.774539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a3480-dc9d-4009-b35a-de3a1fc756c1 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:32.780897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 355/707] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:32 2022] GET /identity/v3/role_assignments?user.id=2a9e63804d3340b09aa7a3b0e7e8f2d1&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:32.782054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a0045-7450-4003-beec-427af26f7901 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.782334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a0045-7450-4003-beec-427af26f7901 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.782606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a0045-7450-4003-beec-427af26f7901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.802725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-cb1a0045-7450-4003-beec-427af26f7901 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:32.803976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-cb1a0045-7450-4003-beec-427af26f7901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:32.831864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:32.833379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:32.833946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:32.834877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:32.836135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=7f5576a90945429a9127a2d4c53a729c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:32.836695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:32.839376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:32.848330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 353/708] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:32 2022] GET /identity/v3/role_assignments?user.id=7f5576a90945429a9127a2d4c53a729c&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=6da07502c09e4fc8afb31b58e434479b => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:32.850619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:32.866807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:32.888888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 356/709] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:32.914452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:33.014388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5dc32-acdd-4155-947b-3e7f67df68f1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:33.030988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fba53-224c-4602-b9ca-7d6daea269cf None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.031273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fba53-224c-4602-b9ca-7d6daea269cf None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.031544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fba53-224c-4602-b9ca-7d6daea269cf None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.032946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 357/710] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:06:33.038823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347281-fea3-45f4-8528-646ae1d10af1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.039103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347281-fea3-45f4-8528-646ae1d10af1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.039371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347281-fea3-45f4-8528-646ae1d10af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.061855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-db347281-fea3-45f4-8528-646ae1d10af1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:33.064651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-db347281-fea3-45f4-8528-646ae1d10af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:33.078128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:33.079164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.079441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.079972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.080628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:33.080934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:33.083917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:33.095548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 354/711] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 31 05:06:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:33.103340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:33.157203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 358/712] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 05:06:33.215114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db347281-fea3-45f4-8528-646ae1d10af1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:33.236089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:33.241451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e3963-f387-4ec7-b370-eae75cb1956d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:33.276339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:33.276950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.277265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.277513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.278136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:33.278429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:33.279795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:33.285790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 355/713] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 31 05:06:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:33.342037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db347281-fea3-45f4-8528-646ae1d10af1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:33.369591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:33.391816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:33.392478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.392758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.393033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.405052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:33.406608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:33.424515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:33.425713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:33.427053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:33.427053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:33.427053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:33.427053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 359/714] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:33.431831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:33.453139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:33.571141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaa753-558e-47d3-b256-3f6f7122280c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:33.587558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066649ec-221d-44b5-a853-2a617f0d79af None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:33.623830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:33.624401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.624675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.625010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.629107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:33.629107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:33.641108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:33.641108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.641108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.641108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.641509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:33.641509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:33.641509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:33.641736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:33.642747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:33.643689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 360/715] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:33 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:33.653208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:33.656363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 356/716] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:33.663748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:33.701540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:33.719937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:33.818855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0df03-575d-410c-8bb8-c514ffdcc0d2 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:33.853867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fe5f5-5cc3-45ad-91e6-0ba9ff99f179 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:33.869224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:33.869840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.870120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.870391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.871028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:33.871328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:33.873241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:33.883404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 361/717] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:06:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:33.888841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:33.929822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6b35-9f53-490d-b47d-ef8b971ebd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:33.930488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6b35-9f53-490d-b47d-ef8b971ebd61 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:33.930713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6b35-9f53-490d-b47d-ef8b971ebd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:33.930983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6b35-9f53-490d-b47d-ef8b971ebd61 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:33.931633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f6b35-9f53-490d-b47d-ef8b971ebd61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:33.933073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f6b35-9f53-490d-b47d-ef8b971ebd61 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:33.983484 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 357/718] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:06:33 2022] POST /identity/v3/users => generated 254 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:34.027636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:34.034788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099059d9-eeb1-4e29-a4c5-48319c5b17c6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:34.085394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4087db3-fe91-4c36-a491-1264c38f528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:34.086037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087db3-fe91-4c36-a491-1264c38f528e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:34.086315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087db3-fe91-4c36-a491-1264c38f528e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:34.086585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4087db3-fe91-4c36-a491-1264c38f528e None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:34.087250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087db3-fe91-4c36-a491-1264c38f528e None admin] RBAC: Adding query filter params (type=network) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:34.087553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087db3-fe91-4c36-a491-1264c38f528e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:34.088996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4087db3-fe91-4c36-a491-1264c38f528e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:34.096026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 362/719] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:06:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:35.054738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff581bd-e4f2-479e-882b-1ed48281da96 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:35.055259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff581bd-e4f2-479e-882b-1ed48281da96 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:35.055259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff581bd-e4f2-479e-882b-1ed48281da96 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:35.056723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 358/720] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:35.062227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0bf80-89df-4e20-9dce-c561cbfffcbf None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:35.062656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0bf80-89df-4e20-9dce-c561cbfffcbf None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:35.062757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0bf80-89df-4e20-9dce-c561cbfffcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:35.090102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-1fb0bf80-89df-4e20-9dce-c561cbfffcbf None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:35.091306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1fb0bf80-89df-4e20-9dce-c561cbfffcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:35.180419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 363/721] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:35.455928 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e1e1-5dfa-4f7a-b33b-971b2e042f53 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:35.456341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e1e1-5dfa-4f7a-b33b-971b2e042f53 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:35.456550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3e1e1-5dfa-4f7a-b33b-971b2e042f53 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:35.458021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 359/722] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:35.463480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab05347-79be-4c25-9b29-ff17ede11209 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:35.463763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab05347-79be-4c25-9b29-ff17ede11209 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:35.464031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab05347-79be-4c25-9b29-ff17ede11209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:35.490073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-dab05347-79be-4c25-9b29-ff17ede11209 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:35.491260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-dab05347-79be-4c25-9b29-ff17ede11209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:35.533224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a630b-0bb8-42c6-93a5-a40408eb7ae6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:35.533535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a630b-0bb8-42c6-93a5-a40408eb7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:35.533766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a630b-0bb8-42c6-93a5-a40408eb7ae6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:35.535614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 360/723] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:35.540886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fd39e-1171-40f1-9389-e2cbc30ebb38 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:35.541206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fd39e-1171-40f1-9389-e2cbc30ebb38 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:35.541482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fd39e-1171-40f1-9389-e2cbc30ebb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:35.566330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0c0fd39e-1171-40f1-9389-e2cbc30ebb38 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:35.567723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0c0fd39e-1171-40f1-9389-e2cbc30ebb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:35.578604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 364/724] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:35.593866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab05347-79be-4c25-9b29-ff17ede11209 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:35.625518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:35.696098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 361/725] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:35.782763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab05347-79be-4c25-9b29-ff17ede11209 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:35.831281 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37fc82-53df-4720-b042-6567eb19b314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:35.832167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37fc82-53df-4720-b042-6567eb19b314 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:35.832438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37fc82-53df-4720-b042-6567eb19b314 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:35.832707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37fc82-53df-4720-b042-6567eb19b314 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:35.845847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37fc82-53df-4720-b042-6567eb19b314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-9e37fc82-53df-4720-b042-6567eb19b314 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:35.850664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:35.851710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:35.852599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 365/726] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:35.857694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fd39e-1171-40f1-9389-e2cbc30ebb38 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:35.876402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:35.952499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37fc82-53df-4720-b042-6567eb19b314 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:35.993647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fd39e-1171-40f1-9389-e2cbc30ebb38 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:36.031328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:36.032332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.032865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.033526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.034806 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:36.035832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:36.037952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:36.048767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 362/727] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:36.050654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:36.087595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:36.111972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37fc82-53df-4720-b042-6567eb19b314 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:36.148951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770743ec-b88c-487f-a3cd-a9cf9846b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:36.149896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770743ec-b88c-487f-a3cd-a9cf9846b568 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.150511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:36.151093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770743ec-b88c-487f-a3cd-a9cf9846b568 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.151546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770743ec-b88c-487f-a3cd-a9cf9846b568 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.163226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770743ec-b88c-487f-a3cd-a9cf9846b568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-770743ec-b88c-487f-a3cd-a9cf9846b568 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:36.168348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:36.169519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:36.170610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:36.173296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 366/728] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:36.174428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770743ec-b88c-487f-a3cd-a9cf9846b568 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:36.178650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca5346-9f84-43fe-a316-2457921562d6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:36.221211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9340b-6911-4299-906d-ac654f287992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:36.221842 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9340b-6911-4299-906d-ac654f287992 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.222176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9340b-6911-4299-906d-ac654f287992 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.222534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9340b-6911-4299-906d-ac654f287992 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.223732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9340b-6911-4299-906d-ac654f287992 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:36.225307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9340b-6911-4299-906d-ac654f287992 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:36.246815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 363/729] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:06:36 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:36.249991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9340b-6911-4299-906d-ac654f287992 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:36.325787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770743ec-b88c-487f-a3cd-a9cf9846b568 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:36.432854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9340b-6911-4299-906d-ac654f287992 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:36.442291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:36.443316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.443799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.444264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.449673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:36.465156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:36.467451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:36.483011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:36.487810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:36.489010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:36.490502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:36.490502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:36.490502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:36.490502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 367/730] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:36.496857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:36.499035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:36.499660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.499939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.500214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.500993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:36.501347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:36.502889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:36.513376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 364/731] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:36.519341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:36.607896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c064c-edb2-4c70-a92d-f7cbf37ed312 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:36.625327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027af8-4a6e-4421-86b9-9128e391d962 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:36.654564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d492c-ab5d-48e3-a3aa-829f8f94ea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:36.655325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d492c-ab5d-48e3-a3aa-829f8f94ea38 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.655593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d492c-ab5d-48e3-a3aa-829f8f94ea38 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.656160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d492c-ab5d-48e3-a3aa-829f8f94ea38 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.656946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d492c-ab5d-48e3-a3aa-829f8f94ea38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:36.657259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d492c-ab5d-48e3-a3aa-829f8f94ea38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:36.658631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d492c-ab5d-48e3-a3aa-829f8f94ea38 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:36.660543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b000a92-48f7-49c6-9d2a-17912e2c6a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:36.661218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000a92-48f7-49c6-9d2a-17912e2c6a8d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.661497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000a92-48f7-49c6-9d2a-17912e2c6a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.661772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b000a92-48f7-49c6-9d2a-17912e2c6a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.671612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 368/732] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:36.672079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b000a92-48f7-49c6-9d2a-17912e2c6a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:36.673275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b10c-3075-4ef5-9d04-ec294a1b355b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.673725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b000a92-48f7-49c6-9d2a-17912e2c6a8d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:36.673856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b10c-3075-4ef5-9d04-ec294a1b355b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.674293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b10c-3075-4ef5-9d04-ec294a1b355b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.675784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 369/733] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:36.676695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1609-b857-47d2-90d6-0c3b3374886e None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.677031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1609-b857-47d2-90d6-0c3b3374886e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.677323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db1609-b857-47d2-90d6-0c3b3374886e None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.678596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 370/734] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:36.681202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db1609-b857-47d2-90d6-0c3b3374886e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6b000a92-48f7-49c6-9d2a-17912e2c6a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:36.692312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:36.698445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:36.699398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:36.699398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:36.699398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:36.699398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 365/735] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:36.699398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ce89-95df-4d42-99d4-4fcb08fc54e0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.699398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ce89-95df-4d42-99d4-4fcb08fc54e0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.699398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403ce89-95df-4d42-99d4-4fcb08fc54e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.715634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3403ce89-95df-4d42-99d4-4fcb08fc54e0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:36.716833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3403ce89-95df-4d42-99d4-4fcb08fc54e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:36.733662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:36.754076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:36.801113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 366/736] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:36.801113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb892ebb-9924-471f-a79e-d84316f11d48 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.801113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb892ebb-9924-471f-a79e-d84316f11d48 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.801113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb892ebb-9924-471f-a79e-d84316f11d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.802656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db1609-b857-47d2-90d6-0c3b3374886e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:36.818696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bb892ebb-9924-471f-a79e-d84316f11d48 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:36.820042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bb892ebb-9924-471f-a79e-d84316f11d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:36.843195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:36.843935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:36.844274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:36.844619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:36.853377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:36.854923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:36.869216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:36.870228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:36.871209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:36.873943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 371/737] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:06:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:36.874790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:36.899137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 367/738] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 05:06:36.900308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb892ebb-9924-471f-a79e-d84316f11d48 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.041433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb93f3-d5e6-453b-8baf-256c930db2f8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.053494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:37.070159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:37.080552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb892ebb-9924-471f-a79e-d84316f11d48 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.083986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.084605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.084887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.086104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.086772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:37.087088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:37.088461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:37.102402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 372/739] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:37.107567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.140583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.141310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.141586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.142089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.143249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:37.143556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:37.145670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:37.169233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 368/740] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:06:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:37.170646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.224019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1114e-14a8-4b68-baf6-1ffc697f406b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.261131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.261768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.262048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.262318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.270545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:37.271990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:37.281595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8887d-f753-4432-be0e-162eb8d87073 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:37.284451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:37.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 373/741] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:37.286616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.317590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:37.327409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d675-16e4-4508-8183-cf55ef7758db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.328039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d675-16e4-4508-8183-cf55ef7758db None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.328317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d675-16e4-4508-8183-cf55ef7758db None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.328585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781d675-16e4-4508-8183-cf55ef7758db None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.329268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781d675-16e4-4508-8183-cf55ef7758db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:37.337869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781d675-16e4-4508-8183-cf55ef7758db None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:37.353593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 369/742] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:06:37 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:37.354458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d675-16e4-4508-8183-cf55ef7758db None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.386128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:37.412493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282296db-8a95-4ecf-988f-22a92dcca96f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.460235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.461344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.461841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.462295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.480959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:37.483406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:37.504890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:37.505980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:37.506937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:37.506937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:37.506937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:37.506937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 374/743] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:37.506937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.509535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781d675-16e4-4508-8183-cf55ef7758db None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.547030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4431ffa-3d55-45d1-88f7-14ed4a774860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.547697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4431ffa-3d55-45d1-88f7-14ed4a774860 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.548031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4431ffa-3d55-45d1-88f7-14ed4a774860 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.548307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4431ffa-3d55-45d1-88f7-14ed4a774860 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.564233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4431ffa-3d55-45d1-88f7-14ed4a774860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a4431ffa-3d55-45d1-88f7-14ed4a774860 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:37.569778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:37.570969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 370/744] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:37.572090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4431ffa-3d55-45d1-88f7-14ed4a774860 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.607072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:37.634743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4160b-c38a-494c-8157-f8c5524a3396 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.672458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:37.672767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.673526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.674067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.675376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.676240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:37.676479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:37.678187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:37.702611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4431ffa-3d55-45d1-88f7-14ed4a774860 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.704235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 375/745] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 31 05:06:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:37.706310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.747469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.748077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.748325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.748650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.749340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:37.749686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:37.751109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:37.769793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 371/746] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:37.769793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.854742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9fcf3-9364-4e96-a63e-b56fc136f9a0 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.874851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031d1d6-6ce1-479d-a6c6-a6a762607243 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:37.893059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:37.903642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.904683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.905154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.905496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.906481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:37.906857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:37.908951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:37.919788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29443002-24e3-46a7-91bd-549bc6a74b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:37.920652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443002-24e3-46a7-91bd-549bc6a74b3f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:37.920761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 376/747] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:37.921229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443002-24e3-46a7-91bd-549bc6a74b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:37.921697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443002-24e3-46a7-91bd-549bc6a74b3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:37.921800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:37.932595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:38.022883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29443002-24e3-46a7-91bd-549bc6a74b3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.024629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29443002-24e3-46a7-91bd-549bc6a74b3f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.066514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34623d-36d6-4d5b-bb53-b55915ab29ad None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.111119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.111795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.112519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.112880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.121686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.123725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:38.142002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:38.142981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:38.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:38.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:38.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:38.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:38.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:38.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:38.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:38.143981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:38.148147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 377/748] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:38.149241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.174442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 372/749] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:06:38.176029 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29443002-24e3-46a7-91bd-549bc6a74b3f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.224096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:38.227819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:38.287874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac8c7b-44bc-4fe0-a9dd-ef6af3763b37 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.292360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29443002-24e3-46a7-91bd-549bc6a74b3f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.331266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.332212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.332482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.332907 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.333157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.333497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.333625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.333950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.334614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:38.335065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.337004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.347159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.349419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.353482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 373/750] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:38.354502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:38.366985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:38.368065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:38.368997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:38.368997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:38.368997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:38.368997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 378/751] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:38.368997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.466433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:38.470656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451250f3-db9c-43f2-9d77-fcdc2aab4009 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.479106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b409b-45b3-4ecc-8c6b-e8f6301852be None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.487138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:38.506556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0155b-8032-450e-a93d-88bf3cf678c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.507200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0155b-8032-450e-a93d-88bf3cf678c5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.507479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0155b-8032-450e-a93d-88bf3cf678c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.507748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0155b-8032-450e-a93d-88bf3cf678c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.515911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b2b41-d613-4dea-a6be-af8616706f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.516580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b2b41-d613-4dea-a6be-af8616706f57 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.516858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b2b41-d613-4dea-a6be-af8616706f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.517408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b2b41-d613-4dea-a6be-af8616706f57 None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/7f5576a90945429a9127a2d4c53a729c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.519207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b2b41-d613-4dea-a6be-af8616706f57 None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=7f5576a90945429a9127a2d4c53a729c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.519797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0155b-8032-450e-a93d-88bf3cf678c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.520692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b2b41-d613-4dea-a6be-af8616706f57 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.521298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0155b-8032-450e-a93d-88bf3cf678c5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.537200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 379/752] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:06:38 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/7f5576a90945429a9127a2d4c53a729c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f5d0155b-8032-450e-a93d-88bf3cf678c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:38.538540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:38.539457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:38.540447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:38.540447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:38.540447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:38.540447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 374/753] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:38.545728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd6a4-3421-436d-8a7e-6dae9431f91a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.545728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd6a4-3421-436d-8a7e-6dae9431f91a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.545728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd6a4-3421-436d-8a7e-6dae9431f91a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.545728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 375/754] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:38.546119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b2b41-d613-4dea-a6be-af8616706f57 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.546836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd6a4-3421-436d-8a7e-6dae9431f91a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.672398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b2b41-d613-4dea-a6be-af8616706f57 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.681344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd6a4-3421-436d-8a7e-6dae9431f91a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.710497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539355-4971-402f-97fc-df6b83d067c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.710826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539355-4971-402f-97fc-df6b83d067c4 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.711087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539355-4971-402f-97fc-df6b83d067c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.711364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539355-4971-402f-97fc-df6b83d067c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.712120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e539355-4971-402f-97fc-df6b83d067c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:38.712319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e539355-4971-402f-97fc-df6b83d067c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.713736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e539355-4971-402f-97fc-df6b83d067c4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.723594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.724427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.724863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.725300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.726210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:38.726749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.727482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 380/755] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:38.728121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.728724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00070a-05cd-4899-b857-83240effe02d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.729013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00070a-05cd-4899-b857-83240effe02d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.729359 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00070a-05cd-4899-b857-83240effe02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.742887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 376/756] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:38.743566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.747922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-1e00070a-05cd-4899-b857-83240effe02d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:38.749160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1e00070a-05cd-4899-b857-83240effe02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:38.771153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:38.771370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:38.822405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 381/757] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:38.823278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00070a-05cd-4899-b857-83240effe02d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.868722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d644a-b779-4391-90b6-8408687341c3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.920812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.922136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.922743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.923455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:38.932691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00070a-05cd-4899-b857-83240effe02d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:38.934421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:38.936983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:38.952319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:38.953338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:06:38.954318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:38.957658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 377/758] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:06:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:38.962905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:38.994290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:38.995103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:38.995213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:38.995455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.011598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.013145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:39.033939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:39.034965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:39.035910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 382/759] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:39.040884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:39.054286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:39.084620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6427fa-1bc4-427b-b3d2-bb015d1e5ed4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.101442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:39.123651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:39.124277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.124557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.124834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.125602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:39.125910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.127343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:39.148518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 378/760] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 31 05:06:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:39.154557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:39.249418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6584f-0bec-4838-9bc4-0f45ca7e41d3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.292475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:39.293111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.293540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.293818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.294808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:39.295118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.296553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:39.309420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a84a-071d-4234-87c9-49597d416a5c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.312982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 383/761] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:39.313858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:39.339117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:39.350456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafefe1f-d8b8-42c9-b271-e9d751a6ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:39.351331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafefe1f-d8b8-42c9-b271-e9d751a6ce5f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.351756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafefe1f-d8b8-42c9-b271-e9d751a6ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.352172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafefe1f-d8b8-42c9-b271-e9d751a6ce5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.414624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:39.425827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafefe1f-d8b8-42c9-b271-e9d751a6ce5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.427602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafefe1f-d8b8-42c9-b271-e9d751a6ce5f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:39.443895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145365b-d35e-4643-b867-8b8992a040b6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.490755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:39.491394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.491674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.491949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.492542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.493957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:39.502808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:39.504307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:39.505427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:39.509357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 384/762] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 31 05:06:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:39.510152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:39.541583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 379/763] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:06:39.543129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b14f6-21dc-4f94-b1d6-abe8bfc28980 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.543561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b14f6-21dc-4f94-b1d6-abe8bfc28980 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.543978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b14f6-21dc-4f94-b1d6-abe8bfc28980 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.545655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 380/764] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:39.546565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b14f6-21dc-4f94-b1d6-abe8bfc28980 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:39.577015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:39.630575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c5633-652b-41fa-9db5-ca1a3e1b5659 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.658531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b14f6-21dc-4f94-b1d6-abe8bfc28980 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.667869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:39.668625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.669000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.669385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.670222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=2a9e63804d3340b09aa7a3b0e7e8f2d1) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:39.670625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.672145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:39.689129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 385/765] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:39 2022] GET /identity/v3/role_assignments?user.id=2a9e63804d3340b09aa7a3b0e7e8f2d1&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=6da07502c09e4fc8afb31b58e434479b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:39.689129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:39.689129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:39.714258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb414c74-a7bf-44bb-9ef0-c2fc566a4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:39.715154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414c74-a7bf-44bb-9ef0-c2fc566a4070 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.715439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414c74-a7bf-44bb-9ef0-c2fc566a4070 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.715713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414c74-a7bf-44bb-9ef0-c2fc566a4070 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.716618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb414c74-a7bf-44bb-9ef0-c2fc566a4070 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:39.717379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb414c74-a7bf-44bb-9ef0-c2fc566a4070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.719102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb414c74-a7bf-44bb-9ef0-c2fc566a4070 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:39.729254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 381/766] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 31 05:06:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:39.730778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cf33a-c857-4e2d-90d6-3b8148c1b56f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.731469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cf33a-c857-4e2d-90d6-3b8148c1b56f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.731753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cf33a-c857-4e2d-90d6-3b8148c1b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.751684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-010cf33a-c857-4e2d-90d6-3b8148c1b56f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:39.753030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-010cf33a-c857-4e2d-90d6-3b8148c1b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:39.807367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeadf0d-767f-4b77-a43f-d002c03fe288 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.837287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 382/767] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:39.838164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cf33a-c857-4e2d-90d6-3b8148c1b56f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:39.845490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:39.846405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.846882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.847459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.858821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.860523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:39.864697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:39.875594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:39.876613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:39.877595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:39.877595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:39.877595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:39.880876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 386/768] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:39.886476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:39.945768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:39.953890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cf33a-c857-4e2d-90d6-3b8148c1b56f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.992053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c31fe-78ee-4c9a-bdaa-c911ad748c3e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:39.992253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:39.992890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:39.993233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:39.993508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:39.994202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:39.994505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:39.996578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.001589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 383/769] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 31 05:06:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:40.009912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.059664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:40.061775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.062231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.063320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.064115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:40.065915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:40.067841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.091237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 387/770] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:40.096783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.180113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:40.206808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d49a5-906c-41b8-a23e-97626879d03e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:40.219263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78010f50-5934-4bea-96c5-9ce2e5bfeccd None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:40.237461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:40.248740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:40.249410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.249695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.249957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.250666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] RBAC: Adding query filter params (interface=public, service_id=1dfe1138567a4f71adaa2923df139720, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:40.250962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:40.252324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.260090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:40.260664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.260898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 384/771] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/endpoints?service_id=1dfe1138567a4f71adaa2923df139720&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:40.261012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.261221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.261750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.273623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:40.275174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:40.287672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:40.288595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 388/772] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:40.289942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.382255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a29e1a-b105-46ec-8eec-cbd649b98c7a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:40.394014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1366f18-acf1-4420-9a02-67ed44fa12d4 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:40.423604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:40.424629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.425067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.425899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.427039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:40.428983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.437971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2485a-2cb3-442a-a2e4-25908e5fdb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:40.438784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2485a-2cb3-442a-a2e4-25908e5fdb1d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.439155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2485a-2cb3-442a-a2e4-25908e5fdb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.439517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2485a-2cb3-442a-a2e4-25908e5fdb1d None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.440223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2485a-2cb3-442a-a2e4-25908e5fdb1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:40.440756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:40.441837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:40.442719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:40.443471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2485a-2cb3-442a-a2e4-25908e5fdb1d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.445699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 385/773] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:40.446698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.452916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 389/774] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:40.454893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2485a-2cb3-442a-a2e4-25908e5fdb1d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.489493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:40.551376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:40.630233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2485a-2cb3-442a-a2e4-25908e5fdb1d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:40.630979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc44147-92e5-4da0-8589-66b8945913e1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:40.673730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a2904-b1ce-41e0-baf2-c288d1922036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:40.674088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458d76d-4b13-46ba-91b6-0221e8fcfe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:40.674356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a2904-b1ce-41e0-baf2-c288d1922036 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.674639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a2904-b1ce-41e0-baf2-c288d1922036 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.674744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d76d-4b13-46ba-91b6-0221e8fcfe4b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.674913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a2904-b1ce-41e0-baf2-c288d1922036 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.675010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d76d-4b13-46ba-91b6-0221e8fcfe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.675450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458d76d-4b13-46ba-91b6-0221e8fcfe4b None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.681113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a2904-b1ce-41e0-baf2-c288d1922036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:40.681254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458d76d-4b13-46ba-91b6-0221e8fcfe4b None admin] RBAC: Adding query filter params (name=network) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:40.681335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a2904-b1ce-41e0-baf2-c288d1922036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:40.681409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458d76d-4b13-46ba-91b6-0221e8fcfe4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:40.681409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458d76d-4b13-46ba-91b6-0221e8fcfe4b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.681569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a2904-b1ce-41e0-baf2-c288d1922036 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.683457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 390/775] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:40.684778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c355-0661-45d0-b272-42ec27b582fa None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.685580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c355-0661-45d0-b272-42ec27b582fa None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.685860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335c355-0661-45d0-b272-42ec27b582fa None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.687969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 391/776] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:40.688775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c355-0661-45d0-b272-42ec27b582fa None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.694794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 386/777] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:40.696152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432488e4-c69b-47b5-a488-a8d318585a54 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.696507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432488e4-c69b-47b5-a488-a8d318585a54 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.696871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432488e4-c69b-47b5-a488-a8d318585a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.715672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-432488e4-c69b-47b5-a488-a8d318585a54 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:40.716972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-432488e4-c69b-47b5-a488-a8d318585a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:40.805335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 387/778] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:40.806322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432488e4-c69b-47b5-a488-a8d318585a54 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.814614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335c355-0661-45d0-b272-42ec27b582fa None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:40.825718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:40.829505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:40.853049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:40.853700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:40.853977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:40.854248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:40.854887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] RBAC: Adding query filter params (type=network) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:40.855190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:40.856763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:40.862238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 392/779] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:40.870829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:40.970303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432488e4-c69b-47b5-a488-a8d318585a54 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:41.010789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:41.011415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:41.011694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:41.011967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:41.012694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=ed29db7bc9ab441eb53fdbdcfd656c3d) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:41.013001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:41.014935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:41.021947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 388/780] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/role_assignments?user.id=ed29db7bc9ab441eb53fdbdcfd656c3d&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:41.083337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478db30-5f68-4d8b-a69c-66eb20258395 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:41.138966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:41.139901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:41.140186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:41.140451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:41.141272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] RBAC: Adding query filter params (interface=public, service_id=f46c5c09843249258188070ce4873f59, region_id=RegionOne) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:41.141583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:41.142977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:41.156510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 393/781] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 31 05:06:40 2022] GET /identity/v3/endpoints?service_id=f46c5c09843249258188070ce4873f59&interface=public®ion_id=RegionOne => generated 194 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:41.162445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:41.228232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:41.260531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:41.298671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:41.304536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070ef0e-1660-4851-9ba2-cf1afd0bb424 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:41.342047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6fc96-6881-47a5-b332-2cbccd1e74f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:41.343190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6fc96-6881-47a5-b332-2cbccd1e74f7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:41.343765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6fc96-6881-47a5-b332-2cbccd1e74f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:41.344247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6fc96-6881-47a5-b332-2cbccd1e74f7 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:41.345075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6fc96-6881-47a5-b332-2cbccd1e74f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:41.346677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6fc96-6881-47a5-b332-2cbccd1e74f7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:41.352672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 389/782] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:06:41 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:41.401616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55145b93-44e5-4ad7-9c73-ef08f8ac73ee None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:41.439520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413efc9-ddb8-48e8-8390-837398b68ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:41.440165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413efc9-ddb8-48e8-8390-837398b68ffa None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:41.440443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413efc9-ddb8-48e8-8390-837398b68ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:41.440751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413efc9-ddb8-48e8-8390-837398b68ffa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:41.452611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413efc9-ddb8-48e8-8390-837398b68ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-4413efc9-ddb8-48e8-8390-837398b68ffa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:41.458669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:41.459755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:41.460624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 394/783] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:41.467912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6fc96-6881-47a5-b332-2cbccd1e74f7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:41.625244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6fc96-6881-47a5-b332-2cbccd1e74f7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:41.663780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:41.669882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:41.670897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:41.671538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:41.671810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:41.672480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:41.672779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:41.674243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:41.684983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 390/784] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:41.690691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413efc9-ddb8-48e8-8390-837398b68ffa None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:41.794603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:41.803961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413efc9-ddb8-48e8-8390-837398b68ffa None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:41.839994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab7723-6a80-4e28-ad11-8ed7b51205aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:41.840629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab7723-6a80-4e28-ad11-8ed7b51205aa None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:41.840910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab7723-6a80-4e28-ad11-8ed7b51205aa None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:41.841217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab7723-6a80-4e28-ad11-8ed7b51205aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:41.852149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab7723-6a80-4e28-ad11-8ed7b51205aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:41.853678 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab7723-6a80-4e28-ad11-8ed7b51205aa None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-d4ab7723-6a80-4e28-ad11-8ed7b51205aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:41.869763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:41.870759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:41.871687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:41.871687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:41.871687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:41.871687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 395/785] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:41.878037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:41.914842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff763-06ff-47fd-ad24-8538bdf1781b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:41.915681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff763-06ff-47fd-ad24-8538bdf1781b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:41.916142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff763-06ff-47fd-ad24-8538bdf1781b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:41.918106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 396/786] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:06:41.927717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054298a-7d60-4bdb-909f-987e06b7f44c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:41.928274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054298a-7d60-4bdb-909f-987e06b7f44c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:41.928981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054298a-7d60-4bdb-909f-987e06b7f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:41.953191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d054298a-7d60-4bdb-909f-987e06b7f44c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:41.954515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d054298a-7d60-4bdb-909f-987e06b7f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:42.017309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a0502-7032-4f85-8e97-5bd9215ed0fa None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:42.087706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 397/787] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:42.090093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:42.090714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:42.090992 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:42.091261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:42.091907 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:42.092211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:42.093618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:42.107144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 391/788] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:42.114668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054298a-7d60-4bdb-909f-987e06b7f44c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:42.211335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:42.246826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054298a-7d60-4bdb-909f-987e06b7f44c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:42.286585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:42.287587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:42.288093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:42.288590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:42.296615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:42.298343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:42.310861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:42.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:06:42.313412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:42.316116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 398/789] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:06:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:42.322152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:42.379839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:42.381032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:42.432450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f5764-bc10-42b7-ba94-7fe66f40befa None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:42.468919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:42.470352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:42.470835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:42.471319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:42.472279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:42.472969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:42.474661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:42.494592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 392/790] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:06:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:42.500723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:42.573326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5988f-62fc-4b84-a25c-de379b8d04bd None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:42.647109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df262a-bc5e-4bd3-b4c6-eb7ed6f223a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:42.647768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df262a-bc5e-4bd3-b4c6-eb7ed6f223a3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:42.648044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df262a-bc5e-4bd3-b4c6-eb7ed6f223a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:42.648313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df262a-bc5e-4bd3-b4c6-eb7ed6f223a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:42.654966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:42.674568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df262a-bc5e-4bd3-b4c6-eb7ed6f223a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-23df262a-bc5e-4bd3-b4c6-eb7ed6f223a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:42.679984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:42.680992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:42.681934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:42.689525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 399/791] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:42.695248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df262a-bc5e-4bd3-b4c6-eb7ed6f223a3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:42.741556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a659e-5a2f-400b-b3a2-239d9daab22e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:42.757434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:42.787748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709e913-80a4-4495-8c4f-61ff4e87a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:42.788831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709e913-80a4-4495-8c4f-61ff4e87a43d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:42.789359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709e913-80a4-4495-8c4f-61ff4e87a43d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:42.789915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709e913-80a4-4495-8c4f-61ff4e87a43d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:42.830166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df262a-bc5e-4bd3-b4c6-eb7ed6f223a3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:42.887323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709e913-80a4-4495-8c4f-61ff4e87a43d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:42.889157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709e913-80a4-4495-8c4f-61ff4e87a43d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:42.895431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76e5df-3259-4567-b047-269694e5e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:42.896058 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e5df-3259-4567-b047-269694e5e569 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:42.896334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e5df-3259-4567-b047-269694e5e569 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:42.896607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76e5df-3259-4567-b047-269694e5e569 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:42.897314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76e5df-3259-4567-b047-269694e5e569 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:42.897614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76e5df-3259-4567-b047-269694e5e569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:42.898982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76e5df-3259-4567-b047-269694e5e569 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:42.908013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 400/792] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:42.909244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8f6b5-2e87-457d-a7c3-8ad2cc00f154 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:42.909676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8f6b5-2e87-457d-a7c3-8ad2cc00f154 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:42.909947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8f6b5-2e87-457d-a7c3-8ad2cc00f154 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:42.915210 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 401/793] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:42.915927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8f6b5-2e87-457d-a7c3-8ad2cc00f154 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:42.974051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:43.007303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 393/794] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:06:43.009110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b2676-b7e2-4436-ab27-343e217bd3d9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.009603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b2676-b7e2-4436-ab27-343e217bd3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.010097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b2676-b7e2-4436-ab27-343e217bd3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.021952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8f6b5-2e87-457d-a7c3-8ad2cc00f154 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.031869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5c7b2676-b7e2-4436-ab27-343e217bd3d9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:43.033454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c7b2676-b7e2-4436-ab27-343e217bd3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:43.044183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:43.056384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d595f-b48e-4d39-a815-b07706bdc017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.057285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d595f-b48e-4d39-a815-b07706bdc017 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.057399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d595f-b48e-4d39-a815-b07706bdc017 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.057583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d595f-b48e-4d39-a815-b07706bdc017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.110588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 394/795] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:43.112103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b2676-b7e2-4436-ab27-343e217bd3d9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.240242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d595f-b48e-4d39-a815-b07706bdc017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:43.242668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d595f-b48e-4d39-a815-b07706bdc017 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:43.244495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b2676-b7e2-4436-ab27-343e217bd3d9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-306d595f-b48e-4d39-a815-b07706bdc017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:43.262030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:43.263249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:43.264419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:43.264419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:43.264419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:43.271666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 402/796] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:43.271666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e8cbf-ccaf-4497-bb64-131719c93ed2 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.271666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e8cbf-ccaf-4497-bb64-131719c93ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.271666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e8cbf-ccaf-4497-bb64-131719c93ed2 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.273720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 403/797] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:43.274915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e8cbf-ccaf-4497-bb64-131719c93ed2 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.295589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7fb2b-ea06-4231-b508-d7a042c6a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.296841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7fb2b-ea06-4231-b508-d7a042c6a68a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.297371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7fb2b-ea06-4231-b508-d7a042c6a68a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.298078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7fb2b-ea06-4231-b508-d7a042c6a68a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.313013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7fb2b-ea06-4231-b508-d7a042c6a68a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:43.314727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7fb2b-ea06-4231-b508-d7a042c6a68a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:43.318032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-99f7fb2b-ea06-4231-b508-d7a042c6a68a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:43.335870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:43.336917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:43.337893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:43.337893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:43.337893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:43.337893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 395/798] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:43.338696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46d83-92ee-4d18-b1df-fc27120809b9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.338977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46d83-92ee-4d18-b1df-fc27120809b9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.339249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c46d83-92ee-4d18-b1df-fc27120809b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.357623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-77c46d83-92ee-4d18-b1df-fc27120809b9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:43.358838 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-77c46d83-92ee-4d18-b1df-fc27120809b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:43.404303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e8cbf-ccaf-4497-bb64-131719c93ed2 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.415496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:43.431079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 396/799] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:43.431731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c46d83-92ee-4d18-b1df-fc27120809b9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.449947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.451197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.451621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.452053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.452954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:43.453971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:43.455853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:43.472300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 404/800] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:43.474071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.547511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c46d83-92ee-4d18-b1df-fc27120809b9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.578117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:43.589837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d23f5-0663-4511-bf67-e11a291453bd None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.594848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.595650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.596095 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.596508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.597375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:43.597822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:43.599873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:43.616505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 397/801] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:43.617931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.627384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.628318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.628738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.629163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.629851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:43.631345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:43.641898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:43.643130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 05:06:43.644313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:43.649443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 405/802] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:43.650364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.691342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:43.734671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19e853-e2e5-4dbe-adf3-671fd9da7197 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.771851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.772510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.772785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.773052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.776376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce74a2-017a-48a1-bf4d-ceb95ac14b72 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.780743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:43.782207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:43.793967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:43.795040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:43.796064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 398/803] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:43.797384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.821289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d508-d691-44af-b86f-18316e8909da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.822232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d508-d691-44af-b86f-18316e8909da None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.822232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d508-d691-44af-b86f-18316e8909da None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.822616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d508-d691-44af-b86f-18316e8909da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.829480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d508-d691-44af-b86f-18316e8909da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:43.830915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d508-d691-44af-b86f-18316e8909da None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-5598d508-d691-44af-b86f-18316e8909da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:43.842211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:43.843161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 406/804] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:43.844635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d508-d691-44af-b86f-18316e8909da None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.849839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:43.906765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba82090-f9cc-4f21-b05f-c34cade4c336 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.933595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:43.943656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.943875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d508-d691-44af-b86f-18316e8909da None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:43.944270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.944551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.944824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.945498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:43.945810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:43.947186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:43.951547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 399/805] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:43.952326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:43.978983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872b465-206e-4a4b-9550-39ff0b67df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:43.979617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872b465-206e-4a4b-9550-39ff0b67df77 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:43.979899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872b465-206e-4a4b-9550-39ff0b67df77 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:43.980167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872b465-206e-4a4b-9550-39ff0b67df77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:43.991008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872b465-206e-4a4b-9550-39ff0b67df77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-3872b465-206e-4a4b-9550-39ff0b67df77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:43.995815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:43.996797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:43.997702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:44.001886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 407/806] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:44.002960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a721-4d36-4eeb-89dc-9bf2842c41d1 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.003412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a721-4d36-4eeb-89dc-9bf2842c41d1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.003547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254a721-4d36-4eeb-89dc-9bf2842c41d1 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.004923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 408/807] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:44.005650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254a721-4d36-4eeb-89dc-9bf2842c41d1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.055601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8d07c-fec5-4b34-9794-7760f5f909aa None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.064132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:44.089963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.090494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.090777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.091042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.091783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:44.092090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.093549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.109479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254a721-4d36-4eeb-89dc-9bf2842c41d1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.110397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 400/808] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 31 05:06:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:44.111203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.144128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.144914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.145237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.145512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.146208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:44.146513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.147933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.159739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 409/809] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:44.160364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.176932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:44.211351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0a15c-6267-453a-8f47-5c179b1dc39e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.245225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85697341-5ca4-4e9b-962e-65b1680c36f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.245835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697341-5ca4-4e9b-962e-65b1680c36f1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.246112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697341-5ca4-4e9b-962e-65b1680c36f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.246403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697341-5ca4-4e9b-962e-65b1680c36f1 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.247035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85697341-5ca4-4e9b-962e-65b1680c36f1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:44.247333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85697341-5ca4-4e9b-962e-65b1680c36f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.248699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85697341-5ca4-4e9b-962e-65b1680c36f1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.253455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 401/810] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:44.254690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dea680-af01-466e-bc36-e5bb9561f166 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.254972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dea680-af01-466e-bc36-e5bb9561f166 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.255251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dea680-af01-466e-bc36-e5bb9561f166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.261353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e51ef-60f9-48c0-9db4-ed952768db75 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.272757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-61dea680-af01-466e-bc36-e5bb9561f166 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:44.273995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-61dea680-af01-466e-bc36-e5bb9561f166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:44.295518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.296121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.296402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.296673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.297359 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:44.297794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:44.297913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.299383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.307752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 410/811] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:44.308382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.345801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 402/812] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:44.346565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dea680-af01-466e-bc36-e5bb9561f166 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.384132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:44.409532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd851-1356-47a7-ae99-f04a9c09a7c6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.444897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.445564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.445843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.446108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.457325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.458537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dea680-af01-466e-bc36-e5bb9561f166 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.458754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:44.473515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:44.474527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:44.475519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:44.475519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:44.475519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:44.479449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 411/813] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:44.480260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.496097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.497058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.497368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.497645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.498389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=7f5576a90945429a9127a2d4c53a729c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:44.498678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.500109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.517117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 403/814] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/role_assignments?user.id=7f5576a90945429a9127a2d4c53a729c&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=6da07502c09e4fc8afb31b58e434479b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:44.517117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.545557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:44.626880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbbf89-1eca-4139-bbc6-4ebf3129fc93 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.642761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7332-8bdc-4e15-b208-ef0bc05ec71d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.661977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:44.674198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570b709-e07c-43ea-a848-86f9dc9d1697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.675451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b709-e07c-43ea-a848-86f9dc9d1697 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.675954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b709-e07c-43ea-a848-86f9dc9d1697 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.676415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b709-e07c-43ea-a848-86f9dc9d1697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.677100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570b709-e07c-43ea-a848-86f9dc9d1697 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.678507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570b709-e07c-43ea-a848-86f9dc9d1697 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.682746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.683395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.683675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.683949 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.696671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.698166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.702666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 412/815] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:06:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:44.703484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570b709-e07c-43ea-a848-86f9dc9d1697 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:44.713736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:44.714857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:44.717065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:44.717065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:44.717065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:44.717065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 404/816] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:44.717065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.828831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:44.846026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570b709-e07c-43ea-a848-86f9dc9d1697 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.857125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98b9a9-546a-4dab-8607-4b4b26288806 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:44.886549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.887481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.887975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.888488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.889530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:44.890357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.891797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.894635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:44.895287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:44.895565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:44.895836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] PATH_INFO: `/v3/services/network` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:44.896433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:44.898225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:44.905579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 413/817] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:44.906587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:44.907851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:44.908834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:44.909889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 405/818] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:44.914921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:44.954313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:45.036218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47144d-93b3-4d16-995b-9a5474f66842 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.036703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5dccb-9de6-4873-8428-e90149136aa9 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.076370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.077014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.077354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.077591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.079895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.080572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.080915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.081338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.082057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:45.082425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.083851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.085627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.087639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.090482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:45.101497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 414/819] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:45.102516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:45.103112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:45.104296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 406/820] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:45.106294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:45.220690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:45.225113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6398f-c25e-444f-9e88-6b2a9b96b71a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.241594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234609e-a5bf-4a24-9174-7b593c88f737 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.262562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.263391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.263798 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.264125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.265212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:45.265612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.267066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.272196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 415/821] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:06:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:45.273598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:45.289047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.289872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.290248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.290616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.299182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.301238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:45.312996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:45.314196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:06:45.315430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:45.321790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 407/822] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:06:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:45.322942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:45.385254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:45.404818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0a785-cfca-4206-83d9-201d1c78ebe6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.445116 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59450f1-3c34-4df9-bbb7-eadd840af941 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.450881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.451612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.451990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.452354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.453181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:45.453583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.455159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.468189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 416/823] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:45.469272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:45.491003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.492269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.492701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.493375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.494207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] RBAC: Adding query filter params (type=network) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:45.494660 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:45.494780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.496449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.504041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 408/824] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:06:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:45.505665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:45.586855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22dab4-fd5e-43d4-b469-65001e9479f8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.626966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c102-4cc5-4dda-a6e4-f0b87c704124 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.629009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.630665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.631121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.631526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.632403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:45.632887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.634511 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.657536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:45.658748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 417/825] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 31 05:06:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:45.659810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:45.674749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c5f3d-d4de-4d55-90f2-291515320747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.675685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5f3d-d4de-4d55-90f2-291515320747 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.676108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5f3d-d4de-4d55-90f2-291515320747 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.676517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5f3d-d4de-4d55-90f2-291515320747 None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/2a9e63804d3340b09aa7a3b0e7e8f2d1/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.679127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c5f3d-d4de-4d55-90f2-291515320747 None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=2a9e63804d3340b09aa7a3b0e7e8f2d1, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.680535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c5f3d-d4de-4d55-90f2-291515320747 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.701645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 409/826] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:06:45 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/2a9e63804d3340b09aa7a3b0e7e8f2d1/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:06:45.703881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c5f3d-d4de-4d55-90f2-291515320747 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:45.817199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:45.852440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5d2d2-0551-4163-a21f-c874982de17a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.912823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ae53-9551-4bf1-9161-940bf263624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.913487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ae53-9551-4bf1-9161-940bf263624d None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.913770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ae53-9551-4bf1-9161-940bf263624d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.914043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416ae53-9551-4bf1-9161-940bf263624d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.914722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416ae53-9551-4bf1-9161-940bf263624d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.915908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c5f3d-d4de-4d55-90f2-291515320747 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:45.916089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416ae53-9551-4bf1-9161-940bf263624d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:45.953129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 418/827] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:06:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:45.969797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:45.970459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:45.970735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:45.971006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:45.983682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:45.985193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:46.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:46.002840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:46.004106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:46.004106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:46.004106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:46.004106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 410/828] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:46.010024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ae53-9551-4bf1-9161-940bf263624d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:46.145996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416ae53-9551-4bf1-9161-940bf263624d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:46.191306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:46.192034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:46.192315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:46.192587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:46.193325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:46.193630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:46.195001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:46.198276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:46.209817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 419/829] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:46.215745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:46.257962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:46.345780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7140b0-c64f-4049-ac8d-5ba08ba32b00 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:46.384718 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:46.385394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:46.385720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:46.385995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:46.395567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:46.397068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:46.408544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:46.409550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:46.410860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 411/830] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:46.415461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:46.533855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5333d-677e-46f1-a181-97baf50d4783 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:46.572060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b0225-20f3-4736-9053-a137117d1b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:46.572673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b0225-20f3-4736-9053-a137117d1b91 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:46.572952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b0225-20f3-4736-9053-a137117d1b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:46.573258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b0225-20f3-4736-9053-a137117d1b91 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:46.573957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b0225-20f3-4736-9053-a137117d1b91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:46.574259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b0225-20f3-4736-9053-a137117d1b91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:46.575680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b0225-20f3-4736-9053-a137117d1b91 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:46.590404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 420/831] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:46.596274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:46.622941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206fbc-2354-4e0e-a7dd-33890be3aa88 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:46.623246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206fbc-2354-4e0e-a7dd-33890be3aa88 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:46.623479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206fbc-2354-4e0e-a7dd-33890be3aa88 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:46.624946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 421/832] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:06:46.630287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4d6d-1a3f-453d-a1e2-22a0592f364d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:46.630923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4d6d-1a3f-453d-a1e2-22a0592f364d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:46.631388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4d6d-1a3f-453d-a1e2-22a0592f364d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:46.651186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-bd4c4d6d-1a3f-453d-a1e2-22a0592f364d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:46.652339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-bd4c4d6d-1a3f-453d-a1e2-22a0592f364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:46.705740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:46.716180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:46.733289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21a3f8-6547-4229-b75e-74bc3962fb0b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:46.733592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 422/833] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:06:46.763013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837aa12-8c3d-4c14-8a97-5d8ef7dcde8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:46.763680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837aa12-8c3d-4c14-8a97-5d8ef7dcde8a None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:46.763960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837aa12-8c3d-4c14-8a97-5d8ef7dcde8a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:46.764232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837aa12-8c3d-4c14-8a97-5d8ef7dcde8a None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/ed29db7bc9ab441eb53fdbdcfd656c3d/roles/852dcf3bc03949d1990e9200addd3104` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:46.779617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837aa12-8c3d-4c14-8a97-5d8ef7dcde8a None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=ed29db7bc9ab441eb53fdbdcfd656c3d, role_id=852dcf3bc03949d1990e9200addd3104)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:46.781061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837aa12-8c3d-4c14-8a97-5d8ef7dcde8a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:46.795778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 412/834] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:06:46 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/ed29db7bc9ab441eb53fdbdcfd656c3d/roles/852dcf3bc03949d1990e9200addd3104 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:06:46.808365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba29f9-1ac1-44fc-9dbd-f19880765c33 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:46.808713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba29f9-1ac1-44fc-9dbd-f19880765c33 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:46.808919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba29f9-1ac1-44fc-9dbd-f19880765c33 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:46.810627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 423/835] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:46.817066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1e05-668e-47c8-8fa8-3788b31aa1d2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:46.817620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1e05-668e-47c8-8fa8-3788b31aa1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:46.818042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf1e05-668e-47c8-8fa8-3788b31aa1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:46.837987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-32cf1e05-668e-47c8-8fa8-3788b31aa1d2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:46.839486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-32cf1e05-668e-47c8-8fa8-3788b31aa1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:46.917868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 413/836] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:46.998647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba29f9-1ac1-44fc-9dbd-f19880765c33 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:47.106886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba29f9-1ac1-44fc-9dbd-f19880765c33 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:47.141893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:47.142885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:47.143371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:47.143943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:47.144758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:47.146357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:47.157611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:47.158616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:47.159624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:47.163964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 424/837] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 31 05:06:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:47.170247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1e05-668e-47c8-8fa8-3788b31aa1d2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:47.187333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:47.239567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:47.258033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:47.296001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf1e05-668e-47c8-8fa8-3788b31aa1d2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:47.308623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a23ee-cc49-4312-918b-d4bdf78e4ffe None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:47.333665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:47.334620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:47.335577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:47.336053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:47.337211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:47.337886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:47.340061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:47.346879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 414/838] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:06:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:47.352331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:47.354198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:47.354844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:47.355122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:47.355387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:47.355974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:47.357356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:47.366642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:47.367725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:47.368621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:47.372569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 425/839] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:47.373876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:47.469067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878520ac-6dd1-412e-b99a-d74c18075d81 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:47.475580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d2d46-cc78-42ce-83e1-37a751721a67 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:47.489942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:47.510451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cce220-c906-406a-a0b4-e665631f576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:47.511601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce220-c906-406a-a0b4-e665631f576c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:47.511870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:47.512322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce220-c906-406a-a0b4-e665631f576c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:47.512542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:47.512751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:47.513017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:47.513447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cce220-c906-406a-a0b4-e665631f576c None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:47.513691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:47.513989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:47.514979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cce220-c906-406a-a0b4-e665631f576c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:47.515491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cce220-c906-406a-a0b4-e665631f576c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:47.515657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:47.517419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cce220-c906-406a-a0b4-e665631f576c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:47.520376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:47.527503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 426/841] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:47.527503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:47.527942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 415/841] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:06:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:47.637820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dc11d-ea0f-4571-9371-285f4aad8a07 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:47.674469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27ffe4-30e3-4684-837d-5d3a67f4cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:47.675149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ffe4-30e3-4684-837d-5d3a67f4cd66 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:47.675426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ffe4-30e3-4684-837d-5d3a67f4cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:47.675693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27ffe4-30e3-4684-837d-5d3a67f4cd66 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:47.676331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27ffe4-30e3-4684-837d-5d3a67f4cd66 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:47.676631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27ffe4-30e3-4684-837d-5d3a67f4cd66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:47.678045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27ffe4-30e3-4684-837d-5d3a67f4cd66 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:47.685167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 427/842] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:47.895260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf50a4-1ad0-404a-9841-b0a29d9bb130 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:47.895787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf50a4-1ad0-404a-9841-b0a29d9bb130 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:47.895787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf50a4-1ad0-404a-9841-b0a29d9bb130 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:47.897436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 416/843] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:47.902789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238382-a7df-481a-8a1a-b0fed7dcfd16 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:47.903070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238382-a7df-481a-8a1a-b0fed7dcfd16 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:47.903344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238382-a7df-481a-8a1a-b0fed7dcfd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:47.922225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-76238382-a7df-481a-8a1a-b0fed7dcfd16 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:47.923497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-76238382-a7df-481a-8a1a-b0fed7dcfd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:47.962722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:47.996384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 428/844] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:48.268006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf50a4-1ad0-404a-9841-b0a29d9bb130 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:48.372452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf50a4-1ad0-404a-9841-b0a29d9bb130 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:48.407739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee15702-8024-4234-9cd5-9b2bb72c95f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:48.408368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15702-8024-4234-9cd5-9b2bb72c95f3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:48.408645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15702-8024-4234-9cd5-9b2bb72c95f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:48.408913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee15702-8024-4234-9cd5-9b2bb72c95f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:48.419508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee15702-8024-4234-9cd5-9b2bb72c95f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cee15702-8024-4234-9cd5-9b2bb72c95f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:48.424452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:48.425485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:48.426557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 417/845] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:48.432134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76238382-a7df-481a-8a1a-b0fed7dcfd16 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:48.534319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76238382-a7df-481a-8a1a-b0fed7dcfd16 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:48.570054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe376156-4167-46fc-88dc-f1875abbab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:48.570661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe376156-4167-46fc-88dc-f1875abbab4b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:48.571139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe376156-4167-46fc-88dc-f1875abbab4b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:48.571214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe376156-4167-46fc-88dc-f1875abbab4b None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:48.571854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe376156-4167-46fc-88dc-f1875abbab4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:48.572159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe376156-4167-46fc-88dc-f1875abbab4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:48.573611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe376156-4167-46fc-88dc-f1875abbab4b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:48.583192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 429/846] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:48.588464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee15702-8024-4234-9cd5-9b2bb72c95f3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:48.662322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:48.707964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee15702-8024-4234-9cd5-9b2bb72c95f3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:48.745892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:48.746530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:48.746808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:48.747078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:48.758279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:48.759699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:48.770234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6b49-a88c-4065-8397-2f62d311ad10 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:48.770715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6b49-a88c-4065-8397-2f62d311ad10 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:48.770801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6b49-a88c-4065-8397-2f62d311ad10 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:48.772321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 430/847] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:48.774926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:48.775886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:48.776835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:48.776835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:48.776835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:48.776835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 418/848] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:48.781880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3dbb3-6b6c-4f43-bdf9-578fe1b8c5af None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:48.782009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:48.782340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3dbb3-6b6c-4f43-bdf9-578fe1b8c5af None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:48.782704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3dbb3-6b6c-4f43-bdf9-578fe1b8c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:48.806676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7fd3dbb3-6b6c-4f43-bdf9-578fe1b8c5af None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:48.808299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7fd3dbb3-6b6c-4f43-bdf9-578fe1b8c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:48.846552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:48.894826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c096833-e07c-4e27-b57e-64d8f81dd601 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:48.899979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 431/849] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:48.911842 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:48.934532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:48.935205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:48.935485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:48.935755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:48.936396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:48.936695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:48.938123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:48.950444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 419/850] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:48.958214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3dbb3-6b6c-4f43-bdf9-578fe1b8c5af None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.060948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3dbb3-6b6c-4f43-bdf9-578fe1b8c5af None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:49.096308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d247e-9495-4929-a846-40337f964265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:49.097196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d247e-9495-4929-a846-40337f964265 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.097398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d247e-9495-4929-a846-40337f964265 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.097572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d247e-9495-4929-a846-40337f964265 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.104907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d247e-9495-4929-a846-40337f964265 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:49.106366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d247e-9495-4929-a846-40337f964265 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-af8d247e-9495-4929-a846-40337f964265 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:49.117996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:49.120121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:49.122432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 432/851] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:06:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:49.126434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.194428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d247e-9495-4929-a846-40337f964265 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.220979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:49.240428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a049-0140-458f-ac36-21e0dbad0c76 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:49.283118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:49.283738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.284015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.284283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.285516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:49.285821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:49.287583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:49.313213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 420/852] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Aug 31 05:06:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:49.315383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.318994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d247e-9495-4929-a846-40337f964265 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:49.354269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:49.359107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e472b9-c5e9-4445-8bb1-e0aa34774c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:49.359753 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e472b9-c5e9-4445-8bb1-e0aa34774c12 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.360029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e472b9-c5e9-4445-8bb1-e0aa34774c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.360446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e472b9-c5e9-4445-8bb1-e0aa34774c12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.372510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e472b9-c5e9-4445-8bb1-e0aa34774c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-b6e472b9-c5e9-4445-8bb1-e0aa34774c12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:49.378230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:49.379244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:49.380111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 433/853] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:06:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:49.385402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e472b9-c5e9-4445-8bb1-e0aa34774c12 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.444748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc505bc-9242-4c4c-b0d1-5cd51b6c375b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:49.481432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f32ba8-42e2-44ec-8af6-1786b375c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:49.482054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32ba8-42e2-44ec-8af6-1786b375c25f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.482333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32ba8-42e2-44ec-8af6-1786b375c25f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.482603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32ba8-42e2-44ec-8af6-1786b375c25f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.488675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:49.507520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e472b9-c5e9-4445-8bb1-e0aa34774c12 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:49.544396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:49.545385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.545886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.546379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.547238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:49.547738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:49.549316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:49.556478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f32ba8-42e2-44ec-8af6-1786b375c25f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:49.557961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f32ba8-42e2-44ec-8af6-1786b375c25f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:49.559082 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 434/854] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:06:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:49.566025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.595098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:49.666168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 421/855] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:06:49.667426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0c72-9912-4373-b62f-e34b72b9ae23 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.667705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0c72-9912-4373-b62f-e34b72b9ae23 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.667981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0c72-9912-4373-b62f-e34b72b9ae23 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.669264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 422/856] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:49.674252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387562c-f385-47dc-aef2-d167271689cd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.674558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387562c-f385-47dc-aef2-d167271689cd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.674827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387562c-f385-47dc-aef2-d167271689cd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.676245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 423/857] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:49.676927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387562c-f385-47dc-aef2-d167271689cd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.679950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b271ceb-8e14-406e-8dd1-84335dc0995a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:49.712239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03632557-3e98-42a8-896a-7d89177f6fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:49.712870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03632557-3e98-42a8-896a-7d89177f6fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.713171 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03632557-3e98-42a8-896a-7d89177f6fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.713445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03632557-3e98-42a8-896a-7d89177f6fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.723975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03632557-3e98-42a8-896a-7d89177f6fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:49.725545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03632557-3e98-42a8-896a-7d89177f6fe8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:49.731824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-03632557-3e98-42a8-896a-7d89177f6fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:49.740607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:49.741613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:49.742558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:49.742558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:49.742558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:49.742558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 435/858] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:49.742847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa7ac5-d375-48b3-ba5e-a11af2c3560a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.743117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa7ac5-d375-48b3-ba5e-a11af2c3560a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.743387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa7ac5-d375-48b3-ba5e-a11af2c3560a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.760826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-bfaa7ac5-d375-48b3-ba5e-a11af2c3560a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:49.762064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-bfaa7ac5-d375-48b3-ba5e-a11af2c3560a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:49.779371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387562c-f385-47dc-aef2-d167271689cd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:49.808180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:49.814140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:49.814761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.815032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.815295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.825545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:49.826913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:49.827344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 436/859] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:49.828623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cd7c5-6e00-4865-8fc8-b59bb9661bae None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:49.828907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cd7c5-6e00-4865-8fc8-b59bb9661bae None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:49.829214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cd7c5-6e00-4865-8fc8-b59bb9661bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:49.847711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d41cd7c5-6e00-4865-8fc8-b59bb9661bae None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:49.848912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d41cd7c5-6e00-4865-8fc8-b59bb9661bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:49.850417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:49.851464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:49.852601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:49.852601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:49.852601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:49.854016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 424/860] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:49.854917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.924140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 437/861] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:49.925326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cd7c5-6e00-4865-8fc8-b59bb9661bae None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:49.983657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523f877-a475-43e9-8261-cbac01c07b15 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:49.992484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:50.025644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.026729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.027160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.027821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.028989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:50.029461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.031021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.044003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cd7c5-6e00-4865-8fc8-b59bb9661bae None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.048465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 425/862] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:50.053895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:50.086448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.087026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.087346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.087635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.088264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:50.088562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.090019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.100517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:50.102683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 438/863] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:50.106752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:50.158313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fa40e-1ec6-4344-bdd1-6b6ac1a24bb4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.192499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.193117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.193402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.193667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.201421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.202853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.209422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace1c21-76e8-424b-b316-0a9d085c28d1 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:50.214200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:50.215261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 426/864] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:06:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:50.216664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:50.228227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:50.246494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e496-665d-489f-a383-1f32d191eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.247107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e496-665d-489f-a383-1f32d191eb40 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.247384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e496-665d-489f-a383-1f32d191eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.247659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6e496-665d-489f-a383-1f32d191eb40 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.248305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6e496-665d-489f-a383-1f32d191eb40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.249702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6e496-665d-489f-a383-1f32d191eb40 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.265443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 439/865] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:06:50 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:50.266217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e496-665d-489f-a383-1f32d191eb40 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:50.327576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b0274-ed02-402b-bca2-5d20656f01e3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.330525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:50.379067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.379638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.379914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.380186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.383449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6e496-665d-489f-a383-1f32d191eb40 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.388015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.390040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:50.402381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:50.403465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:50.404525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:50.404525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:50.404525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:50.404525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:50.404525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:50.404525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:50.404525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:50.404525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:50.406561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 427/866] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:50.407581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:50.424443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995ce0f-975c-47c7-920a-43ded2713d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.425235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995ce0f-975c-47c7-920a-43ded2713d67 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.425574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995ce0f-975c-47c7-920a-43ded2713d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.425905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995ce0f-975c-47c7-920a-43ded2713d67 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.426561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995ce0f-975c-47c7-920a-43ded2713d67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.427905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995ce0f-975c-47c7-920a-43ded2713d67 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.447418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 440/867] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:06:50 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:50.448472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995ce0f-975c-47c7-920a-43ded2713d67 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:50.488615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:50.529860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3606b-6aca-40e5-9e71-dfc7885d6af7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.571766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995ce0f-975c-47c7-920a-43ded2713d67 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.576063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.576886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.577377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.577797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.578748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:50.579412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.582193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.606809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 428/868] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 31 05:06:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:50.613136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:50.630976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.631610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.631892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.632163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.632874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:50.634488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.636240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.640630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:50.653060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 441/869] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:50.659471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:50.748925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507a56f-0c01-405b-a6fd-9e263a1fa13d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.770946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:50.784159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0674cac-bc96-4553-bf4b-13e0a03e396a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:50.786134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef3c2-f372-4729-8e7a-1553c50ca429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.787014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef3c2-f372-4729-8e7a-1553c50ca429 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.787358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef3c2-f372-4729-8e7a-1553c50ca429 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.787698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef3c2-f372-4729-8e7a-1553c50ca429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.825839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:50.826453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:50.826782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:50.827047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:50.827814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=2a9e63804d3340b09aa7a3b0e7e8f2d1) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:50.828341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.829646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.836673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 442/870] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:50 2022] GET /identity/v3/role_assignments?user.id=2a9e63804d3340b09aa7a3b0e7e8f2d1&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=6da07502c09e4fc8afb31b58e434479b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:50.872076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef3c2-f372-4729-8e7a-1553c50ca429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:50.873575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef3c2-f372-4729-8e7a-1553c50ca429 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:50.889268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:50.996990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 429/871] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:50 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 05:06:51.003263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:51.115680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435e8fd-f7c2-4b00-ab87-63e36303697c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:51.151740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:51.152692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:51.153190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:51.153633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:51.167498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:51.169261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:51.185161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:51.186212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:51.187144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:51.187144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:51.187144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:51.188935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 443/872] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:51.199718 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef3c2-f372-4729-8e7a-1553c50ca429 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:51.303544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef3c2-f372-4729-8e7a-1553c50ca429 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:51.317951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:51.344765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:51.345410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:51.345689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:51.345961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:51.346609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:51.346961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:51.348327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:51.360148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 430/873] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:51.365415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:51.374988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:51.474050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007100e8-8145-46ad-b9e3-462ce7c25f5b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:51.508413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:51.509047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:51.509356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:51.509629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:51.516871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:51.518332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:51.530407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:51.531333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:51.532242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 444/874] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:51.539157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:51.644175 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfdbf4-0237-4e16-ba83-0626a729951a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:51.681305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68af24d-3793-412f-9073-856db55834b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:51.681923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af24d-3793-412f-9073-856db55834b2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:51.682202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af24d-3793-412f-9073-856db55834b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:51.682477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68af24d-3793-412f-9073-856db55834b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:51.683173 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68af24d-3793-412f-9073-856db55834b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:51.683479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68af24d-3793-412f-9073-856db55834b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:51.684908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68af24d-3793-412f-9073-856db55834b2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:51.697501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 431/875] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:51.703419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:51.771292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:51.812832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080410f-f428-4daa-97c0-53cedb97a6c3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:51.848725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216be8da-76f1-41b5-887e-09b29d91f5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:51.849361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be8da-76f1-41b5-887e-09b29d91f5df None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:51.849633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be8da-76f1-41b5-887e-09b29d91f5df None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:51.849903 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be8da-76f1-41b5-887e-09b29d91f5df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:51.850625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216be8da-76f1-41b5-887e-09b29d91f5df None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=ed29db7bc9ab441eb53fdbdcfd656c3d) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:51.850928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216be8da-76f1-41b5-887e-09b29d91f5df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:51.852344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216be8da-76f1-41b5-887e-09b29d91f5df None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:51.858855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 445/876] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:51 2022] GET /identity/v3/role_assignments?user.id=ed29db7bc9ab441eb53fdbdcfd656c3d&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:52.296886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7928-06c4-4aa3-94bc-c0d8a35e7ef4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:52.297443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7928-06c4-4aa3-94bc-c0d8a35e7ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:52.297781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7928-06c4-4aa3-94bc-c0d8a35e7ef4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:52.299224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 432/877] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:06:52.304761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc30be-033e-48ca-895b-60d2515baf52 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:52.305182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc30be-033e-48ca-895b-60d2515baf52 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:52.305558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc30be-033e-48ca-895b-60d2515baf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:52.324911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4bfc30be-033e-48ca-895b-60d2515baf52 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:52.326134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4bfc30be-033e-48ca-895b-60d2515baf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:52.398491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 446/878] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:06:52.508541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc37aa-dc19-44ea-b594-bcaec9b76de4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:52.508541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc37aa-dc19-44ea-b594-bcaec9b76de4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:52.508541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc37aa-dc19-44ea-b594-bcaec9b76de4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:52.508541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 433/879] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:52.513908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57199e8-574e-43b4-8593-82a52f0ac125 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:52.514196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57199e8-574e-43b4-8593-82a52f0ac125 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:52.514476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57199e8-574e-43b4-8593-82a52f0ac125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:52.533719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f57199e8-574e-43b4-8593-82a52f0ac125 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:52.534983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f57199e8-574e-43b4-8593-82a52f0ac125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:52.595277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:52.613639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 447/880] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:52.691373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc37aa-dc19-44ea-b594-bcaec9b76de4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:52.723575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:52.795367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc37aa-dc19-44ea-b594-bcaec9b76de4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:52.834471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:52.835115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:52.835392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:52.835666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:52.836251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:52.837655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:52.846559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:52.847604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:52.848532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 434/881] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 31 05:06:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:52.853816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57199e8-574e-43b4-8593-82a52f0ac125 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:52.899927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:52.960215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57199e8-574e-43b4-8593-82a52f0ac125 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:52.994598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80df469-a7ec-41a2-818e-039a145363f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:52.995214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df469-a7ec-41a2-818e-039a145363f3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:52.995535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df469-a7ec-41a2-818e-039a145363f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:52.995809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df469-a7ec-41a2-818e-039a145363f3 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:52.996442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80df469-a7ec-41a2-818e-039a145363f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:52.996743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80df469-a7ec-41a2-818e-039a145363f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:52.998134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80df469-a7ec-41a2-818e-039a145363f3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.002778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 448/882] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:06:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:53.004050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54262-f7bc-4f44-9788-78cee23831a9 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.004327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54262-f7bc-4f44-9788-78cee23831a9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.004595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e54262-f7bc-4f44-9788-78cee23831a9 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.005959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 449/883] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:53.010857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54262-f7bc-4f44-9788-78cee23831a9 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.013751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:53.021204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b988a-4127-4f5d-a86f-77c7e29f1c34 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.057383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8f549-1c1c-41dd-95b7-e1a43f6fbeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.058017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f549-1c1c-41dd-95b7-e1a43f6fbeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.058568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f549-1c1c-41dd-95b7-e1a43f6fbeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.058568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f549-1c1c-41dd-95b7-e1a43f6fbeb2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.059127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8f549-1c1c-41dd-95b7-e1a43f6fbeb2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.060503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8f549-1c1c-41dd-95b7-e1a43f6fbeb2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0fd8f549-1c1c-41dd-95b7-e1a43f6fbeb2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:53.069533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:53.070722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:53.071578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 435/884] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:53.072400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314294e-d1c6-4703-ac32-d0a8a6b2cfe0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.072400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314294e-d1c6-4703-ac32-d0a8a6b2cfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.072400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314294e-d1c6-4703-ac32-d0a8a6b2cfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.078494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:53.090339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f314294e-d1c6-4703-ac32-d0a8a6b2cfe0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:53.091520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f314294e-d1c6-4703-ac32-d0a8a6b2cfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:53.129470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e54262-f7bc-4f44-9788-78cee23831a9 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.166381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.166993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.175117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.175253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 436/885] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:53.175336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.175336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:53.175468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314294e-d1c6-4703-ac32-d0a8a6b2cfe0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.175631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.175631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.175631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 450/886] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:53.181358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.312137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:53.312662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667fae6-0bcc-453b-a0c8-6434b078a2e6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.328824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314294e-d1c6-4703-ac32-d0a8a6b2cfe0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.341742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:53.365679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.366251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.366814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.367026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.367371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.367621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.367763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.368204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.368539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:53.368898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.369467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] RBAC: Adding query filter params (interface=public, service_id=8010f650bd164905b78b14c20bad3bec, region_id=RegionOne) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:53.369952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.370473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.371955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.383154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 437/888] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:53.383315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 451/888] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/endpoints?service_id=8010f650bd164905b78b14c20bad3bec&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:53.384644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.384892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.496972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b2c55-e6f8-4c77-9628-8a3c5a81e09f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.508238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee12c8-7fde-4039-8374-8ae7bfec5535 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.532540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1b29d-1e35-41bb-9e93-654390c3e4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.533180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1b29d-1e35-41bb-9e93-654390c3e4bb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.533447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1b29d-1e35-41bb-9e93-654390c3e4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.533714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1b29d-1e35-41bb-9e93-654390c3e4bb None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.534315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1b29d-1e35-41bb-9e93-654390c3e4bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.536311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1b29d-1e35-41bb-9e93-654390c3e4bb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.542183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 452/889] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:06:53.542974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1b29d-1e35-41bb-9e93-654390c3e4bb None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.558122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.559123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.559580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.560025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.560972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:53.561493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.563328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.570006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 438/890] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:53.575704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.599030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:53.611298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:53.685287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1b29d-1e35-41bb-9e93-654390c3e4bb None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.706175 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec2f7-7b8f-4da1-a031-13c6bb8745dd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.730168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.731246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.731530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.731800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.732443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.733842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:53.743928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:53.745007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:53.745955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 453/891] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:53.750805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.753825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.754437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.754707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.754971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.755680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] RBAC: Adding query filter params (interface=public, service_id=7e01b5a7664f460297065e4c525d9d3f, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:53.755982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.757375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.763258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 439/892] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/endpoints?service_id=7e01b5a7664f460297065e4c525d9d3f&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:53.768975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.854731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:53.873001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6886995f-6b1a-4eca-85c4-c46e4b8109c9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.878498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3d014-bfaf-4ff7-8bc4-211d2483e3fe None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:53.890627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:53.914496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38beccef-b19a-4db7-9cb8-8a5999c5d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.915194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beccef-b19a-4db7-9cb8-8a5999c5d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.915468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beccef-b19a-4db7-9cb8-8a5999c5d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.915741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38beccef-b19a-4db7-9cb8-8a5999c5d5c8 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.916349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beccef-b19a-4db7-9cb8-8a5999c5d5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.917788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38beccef-b19a-4db7-9cb8-8a5999c5d5c8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.922862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:53.923679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 440/893] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:06:53.923938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.924425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.924835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d877e-5681-4b0f-8df7-79a6f094483d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.925230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.925354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d877e-5681-4b0f-8df7-79a6f094483d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.925757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d877e-5681-4b0f-8df7-79a6f094483d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.926626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:53.927141 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:53.931511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 441/894] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:53.931698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:53.933435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934884fa-cfaa-4253-8afa-cf8b35704a2e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:53.933715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934884fa-cfaa-4253-8afa-cf8b35704a2e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:53.933981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934884fa-cfaa-4253-8afa-cf8b35704a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:53.943007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 454/895] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:53.947166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:53.953567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-934884fa-cfaa-4253-8afa-cf8b35704a2e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:53.954798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-934884fa-cfaa-4253-8afa-cf8b35704a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:54.041166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 442/896] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:54.082053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667243a0-bb84-4826-85ff-7f7eeaab54b8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:54.118672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:54.119286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:54.119566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:54.119832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:54.120458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:54.120756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:54.122145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:54.127153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 455/897] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:06:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:06:54.306164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934884fa-cfaa-4253-8afa-cf8b35704a2e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:54.383793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:54.408569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934884fa-cfaa-4253-8afa-cf8b35704a2e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:54.444625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9e8ba-3c22-4bf3-866b-2f36056dc555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:54.445306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9e8ba-3c22-4bf3-866b-2f36056dc555 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:54.445586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9e8ba-3c22-4bf3-866b-2f36056dc555 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:54.445857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9e8ba-3c22-4bf3-866b-2f36056dc555 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:54.456861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9e8ba-3c22-4bf3-866b-2f36056dc555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f1f9e8ba-3c22-4bf3-866b-2f36056dc555 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:54.461977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:54.462905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:54.463776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 443/898] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 31 05:06:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:54.470180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:54.512389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:54.575928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d2fa4-0815-43d3-b453-35f47b2ac3df None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:54.610777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:54.611400 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:54.611715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:54.611990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:54.612708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:54.613203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:54.614752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:54.623618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 456/899] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 31 05:06:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:54.631991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9e8ba-3c22-4bf3-866b-2f36056dc555 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:54.735927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9e8ba-3c22-4bf3-866b-2f36056dc555 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:54.771761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:54.772398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:54.772678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:54.772950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:54.775655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:54.783153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:54.784755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:54.799561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:54.800932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:54.801922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:54.801922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:54.801922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:54.804147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 444/900] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:54.810086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:54.916617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:54.920771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2bf6-14b9-4612-a3e1-03e7eda1ec03 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:54.957426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:54.958416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:54.958918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:54.959382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:54.960210 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:54.960717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:54.962278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:54.975119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 457/901] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:54.980656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:55.086002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78de46-eb1c-43d4-b9c4-3f57a22c3ae3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:55.120595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:55.121285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:55.121565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:55.121837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:55.129880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:55.131343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:06:55.143008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:55.144033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:55.145035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 445/902] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:06:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:55.150496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:55.257179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd163b3-1b28-4403-a8b8-27ff9c43109f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:55.292391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c997c27-5a5c-4054-8ef6-fe0bf2b93e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:55.293003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997c27-5a5c-4054-8ef6-fe0bf2b93e1e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:55.293303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997c27-5a5c-4054-8ef6-fe0bf2b93e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:55.293568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c997c27-5a5c-4054-8ef6-fe0bf2b93e1e None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:55.294294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997c27-5a5c-4054-8ef6-fe0bf2b93e1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:55.294591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997c27-5a5c-4054-8ef6-fe0bf2b93e1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:55.295999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c997c27-5a5c-4054-8ef6-fe0bf2b93e1e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:55.314373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 458/903] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 31 05:06:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:55.320174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:55.373480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:55.427867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb127fc-d24a-4120-89a5-0145f3ecc19b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:55.462638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce83c4d-6be6-427f-bfbf-996f5b52727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:55.463255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce83c4d-6be6-427f-bfbf-996f5b52727e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:55.463534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce83c4d-6be6-427f-bfbf-996f5b52727e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:55.463804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce83c4d-6be6-427f-bfbf-996f5b52727e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:55.532957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce83c4d-6be6-427f-bfbf-996f5b52727e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:55.534588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce83c4d-6be6-427f-bfbf-996f5b52727e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:55.551117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b5a8-fd0b-4131-a4a1-606f7ba4c121 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:55.551423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b5a8-fd0b-4131-a4a1-606f7ba4c121 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:55.551654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2b5a8-fd0b-4131-a4a1-606f7ba4c121 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:55.553134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 459/904] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:55.558963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a074c0-9c26-4d7b-8275-1305a6bf437f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:55.559242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a074c0-9c26-4d7b-8275-1305a6bf437f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:55.559513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a074c0-9c26-4d7b-8275-1305a6bf437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:55.578004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-c7a074c0-9c26-4d7b-8275-1305a6bf437f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:55.579302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c7a074c0-9c26-4d7b-8275-1305a6bf437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:55.589515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:55.600114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:55.670454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 446/905] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:06:55 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:06:55.672255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce83c4d-6be6-427f-bfbf-996f5b52727e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:55.680265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 460/906] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:55.781449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce83c4d-6be6-427f-bfbf-996f5b52727e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:55.818210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce137e-dd82-413c-8311-1bd14a2b298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:55.819280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce137e-dd82-413c-8311-1bd14a2b298b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:55.819770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce137e-dd82-413c-8311-1bd14a2b298b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:55.820288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce137e-dd82-413c-8311-1bd14a2b298b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:55.831442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce137e-dd82-413c-8311-1bd14a2b298b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:55.833350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce137e-dd82-413c-8311-1bd14a2b298b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:55.843377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-47ce137e-dd82-413c-8311-1bd14a2b298b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:55.852089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:55.853073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:55.854049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:55.854049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:55.854049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:55.856198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 447/907] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:55.862044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a074c0-9c26-4d7b-8275-1305a6bf437f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:55.875799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112af47-e959-4d37-bce4-185377502e3c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:55.876105 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112af47-e959-4d37-bce4-185377502e3c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:55.876358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112af47-e959-4d37-bce4-185377502e3c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:55.881784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 448/908] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:06:55.883550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18357754-7fa0-482c-9c0c-8b629df58efc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:55.883832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18357754-7fa0-482c-9c0c-8b629df58efc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:55.884105 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18357754-7fa0-482c-9c0c-8b629df58efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:55.902831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-18357754-7fa0-482c-9c0c-8b629df58efc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:55.904034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-18357754-7fa0-482c-9c0c-8b629df58efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:55.978333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a074c0-9c26-4d7b-8275-1305a6bf437f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:55.986475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 449/909] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:55.992735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18357754-7fa0-482c-9c0c-8b629df58efc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.025027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.025681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.026203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.026481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.027700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:56.028124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.029530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.045134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 461/910] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:56.051125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.069326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:56.110985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18357754-7fa0-482c-9c0c-8b629df58efc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.143414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:56.151056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.151702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.152032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.152350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.152938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.154537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:56.164576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:56.165641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:56.166563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 450/911] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Aug 31 05:06:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:56.171523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.193492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d686d-5bf8-4011-a750-705877ddbfe7 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.240711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d8fb1-1461-43c7-a0c7-9eda3ed8d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.241364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d8fb1-1461-43c7-a0c7-9eda3ed8d5fd None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.241636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d8fb1-1461-43c7-a0c7-9eda3ed8d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.241900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d8fb1-1461-43c7-a0c7-9eda3ed8d5fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.248624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d8fb1-1461-43c7-a0c7-9eda3ed8d5fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.250142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d8fb1-1461-43c7-a0c7-9eda3ed8d5fd None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-c35d8fb1-1461-43c7-a0c7-9eda3ed8d5fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:06:56.261569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:56.262701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 462/912] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:56.263864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1061e0-0e02-48fe-b41a-c910ff5a2358 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.264562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1061e0-0e02-48fe-b41a-c910ff5a2358 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.264562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1061e0-0e02-48fe-b41a-c910ff5a2358 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.265871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 463/913] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:56.266553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1061e0-0e02-48fe-b41a-c910ff5a2358 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.289830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687f57-1f90-42d7-aaf3-57f9b3d5783d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.325213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.325843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.326123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.326394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.327022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:56.327321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.328693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.333400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 451/914] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:06:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:56.334169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.339514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:56.373818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1061e0-0e02-48fe-b41a-c910ff5a2358 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.395883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:56.408337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c4cb9-be79-4bc3-bf55-8eced5e9958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.408966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4cb9-be79-4bc3-bf55-8eced5e9958b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.409275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4cb9-be79-4bc3-bf55-8eced5e9958b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.409598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c4cb9-be79-4bc3-bf55-8eced5e9958b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.410172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c4cb9-be79-4bc3-bf55-8eced5e9958b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.411525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c4cb9-be79-4bc3-bf55-8eced5e9958b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-d45c4cb9-be79-4bc3-bf55-8eced5e9958b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:56.420524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:56.421647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:56.422546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 464/915] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:56.423386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091059d-5e68-4615-9c7c-52df96daa5c2 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.423602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091059d-5e68-4615-9c7c-52df96daa5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.423895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091059d-5e68-4615-9c7c-52df96daa5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.441070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0091059d-5e68-4615-9c7c-52df96daa5c2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:56.442271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0091059d-5e68-4615-9c7c-52df96daa5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:56.442738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cca43-2dd9-47b2-a1e8-ca7f2aa6aac8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.477737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.478341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.478613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.478889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.479579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:56.479881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.481313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.493648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 452/916] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:56.494293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.513230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 465/917] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:56.514093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091059d-5e68-4615-9c7c-52df96daa5c2 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.581471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:56.601356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089d08c-c046-4e8e-bbb6-c0636fcbf9a5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.619511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:56.632741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091059d-5e68-4615-9c7c-52df96daa5c2 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.640698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.641341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.641620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.641889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.642525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:56.642826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.644291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.654011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 453/918] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:06:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:56.654011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.674579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.675321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.675607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.675882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.676514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:56.676817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.678221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.687838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 466/919] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:56.687838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.756626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fccf65-a397-4382-868e-e976d419cd5f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.788232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449335-ee4c-4e4f-bbb7-e403f6525e76 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:56.790544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.791154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.791429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.791693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.792422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] RBAC: Adding query filter params (role.id=69e45fcb7ca44ff3987645cbecb19ebb, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=ed29db7bc9ab441eb53fdbdcfd656c3d) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:56.792726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.794174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.799485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 454/920] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:06:56 2022] GET /identity/v3/role_assignments?user.id=ed29db7bc9ab441eb53fdbdcfd656c3d&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=69e45fcb7ca44ff3987645cbecb19ebb => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:56.800667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.823438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:56.833319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709602e4-da12-440e-899c-873fc5a079ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:56.833876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709602e4-da12-440e-899c-873fc5a079ca None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:56.834119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709602e4-da12-440e-899c-873fc5a079ca None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:56.834411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709602e4-da12-440e-899c-873fc5a079ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:56.835076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709602e4-da12-440e-899c-873fc5a079ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:56.836447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709602e4-da12-440e-899c-873fc5a079ca None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:56.859402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:56.865783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 467/921] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:06:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:56.867116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709602e4-da12-440e-899c-873fc5a079ca None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:56.954631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922114c-1cc0-40c6-8ca2-2fe3c31d3be6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:57.005720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709602e4-da12-440e-899c-873fc5a079ca None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:57.009607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:57.010231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:57.010503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:57.010766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:57.011402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:57.011698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:57.013118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:57.025069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 455/922] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Aug 31 05:06:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:57.031259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:57.054276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286474c7-103a-40b0-908e-1f685803fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:57.055168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286474c7-103a-40b0-908e-1f685803fa3e None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:57.055639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286474c7-103a-40b0-908e-1f685803fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:57.055908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286474c7-103a-40b0-908e-1f685803fa3e None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:57.056563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286474c7-103a-40b0-908e-1f685803fa3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:57.057955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286474c7-103a-40b0-908e-1f685803fa3e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:57.075036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 468/923] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:06:56 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:57.165615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1b32-a9d7-48de-a0c8-400283cc5a0e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:57.174299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:57.214076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00357a59-a719-4192-80d3-fd2b0b0ba328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:57.214764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357a59-a719-4192-80d3-fd2b0b0ba328 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:57.215044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357a59-a719-4192-80d3-fd2b0b0ba328 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:57.215315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357a59-a719-4192-80d3-fd2b0b0ba328 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:57.215982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00357a59-a719-4192-80d3-fd2b0b0ba328 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:57.217382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00357a59-a719-4192-80d3-fd2b0b0ba328 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:57.243538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 456/924] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:06:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:06:58.720153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f4db-4d08-4c29-8942-27564fc4fcfb None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:58.720683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f4db-4d08-4c29-8942-27564fc4fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:58.720683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f4db-4d08-4c29-8942-27564fc4fcfb None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:58.722729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 469/925] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:58.728188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e909c-71c7-4532-ade3-77ba15bebb6c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:58.728648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e909c-71c7-4532-ade3-77ba15bebb6c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:58.728727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e909c-71c7-4532-ade3-77ba15bebb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:58.747650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d64e909c-71c7-4532-ade3-77ba15bebb6c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:58.748846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d64e909c-71c7-4532-ade3-77ba15bebb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:58.825201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 457/926] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:06:58.891100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa45c-5be7-4b68-8205-c48b00c43432 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:58.891404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa45c-5be7-4b68-8205-c48b00c43432 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:58.891577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa45c-5be7-4b68-8205-c48b00c43432 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:58.893039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 470/927] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:58.898410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5058-a481-4b92-9723-04bc027759bd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:58.898939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5058-a481-4b92-9723-04bc027759bd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:58.899409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb5058-a481-4b92-9723-04bc027759bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:58.918694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-55fb5058-a481-4b92-9723-04bc027759bd None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:58.920238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-55fb5058-a481-4b92-9723-04bc027759bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:58.989693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 458/928] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:59.076350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dce169-d83b-4f03-99dc-73fa2859e0fb None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.076679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dce169-d83b-4f03-99dc-73fa2859e0fb None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.076892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dce169-d83b-4f03-99dc-73fa2859e0fb None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.078523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 471/929] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:59.084067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170edf-bbf6-45c1-97b1-9d9f9e39cd1e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.084351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170edf-bbf6-45c1-97b1-9d9f9e39cd1e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.084621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170edf-bbf6-45c1-97b1-9d9f9e39cd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.093762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dce169-d83b-4f03-99dc-73fa2859e0fb None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.107425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a8170edf-bbf6-45c1-97b1-9d9f9e39cd1e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:59.108899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a8170edf-bbf6-45c1-97b1-9d9f9e39cd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:59.121765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:59.139365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:59.199960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 459/930] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:06:59.201446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72cf9-38a0-40a2-a4fb-d4d7fdc5e224 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.201446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72cf9-38a0-40a2-a4fb-d4d7fdc5e224 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.201712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72cf9-38a0-40a2-a4fb-d4d7fdc5e224 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.203134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 460/931] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:06:59.209018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dce169-d83b-4f03-99dc-73fa2859e0fb None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.210521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae6c8-ef6b-4eac-890e-88de565188cd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.211249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae6c8-ef6b-4eac-890e-88de565188cd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.212655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae6c8-ef6b-4eac-890e-88de565188cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.237145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-44cae6c8-ef6b-4eac-890e-88de565188cd None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:06:59.239435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-44cae6c8-ef6b-4eac-890e-88de565188cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:06:59.244804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09a03-d3fa-4f7c-a86d-7bab7ef9492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.245544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09a03-d3fa-4f7c-a86d-7bab7ef9492f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.245900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09a03-d3fa-4f7c-a86d-7bab7ef9492f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.246238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09a03-d3fa-4f7c-a86d-7bab7ef9492f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.257404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf09a03-d3fa-4f7c-a86d-7bab7ef9492f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-9bf09a03-d3fa-4f7c-a86d-7bab7ef9492f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:06:59.262496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:59.263487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:06:59.264339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:59.268847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 472/932] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:06:59.269738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09a03-d3fa-4f7c-a86d-7bab7ef9492f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.311972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 461/933] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:06:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:06:59.313114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cae6c8-ef6b-4eac-890e-88de565188cd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.384375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:59.388292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09a03-d3fa-4f7c-a86d-7bab7ef9492f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.415003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:59.431058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cae6c8-ef6b-4eac-890e-88de565188cd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.432206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.432865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.433433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.433713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.434305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:59.436583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:59.447739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:59.448794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:59.454736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 473/934] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:59.455602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.477049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.477862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.478172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.478446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.479120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:59.479424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:59.480801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:59.489177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 462/935] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:59.490042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.563757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320759c-92e7-4880-baa5-b0875fee0c3c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.593827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d48e5-5c43-4e73-b36a-e96ae930163b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.598048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.598658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.598934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.599205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.599825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:59.600127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:59.601525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:59.606809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 474/936] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:59.607579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.627121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.627741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.628120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.628396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.629049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:59.630367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:59.633025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:59.634653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:59.641566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:59.642737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.643666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 463/937] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:59.644530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.711306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfaec6-95db-46c0-929a-b7d4b8ee0da1 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.744316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.744917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.745114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc9e4-402d-47f7-9722-0c8a59d0f164 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.745474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.745474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.755544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:59.756961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:06:59.771438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:06:59.772438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:06:59.773395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:06:59.773395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:06:59.773395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:06:59.773395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 475/938] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:59.773395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.783789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.784478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.784726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.785010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.785694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:59.787118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:59.789762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING keystone.server.flask.common [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 05:06:59.807542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.sql.core [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 05:06:59.807542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 05:06:59.807542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [parameters: {'id': '9816e043b84e44e59e7ed9478f294e5f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 05:06:59.807542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81573) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9816e043b84e44e59e7ed9478f294e5f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9816e043b84e44e59e7ed9478f294e5f. Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 05:06:59.823421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 05:06:59.824258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application yield resource Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise self.value Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application session.commit() Aug 31 05:06:59.825296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.flush() Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application compat.raise_( Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 05:06:59.826232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 05:06:59.827166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 05:06:59.828010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [parameters: {'id': '9816e043b84e44e59e7ed9478f294e5f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.828921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:06:59.831364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9816e043b84e44e59e7ed9478f294e5f. Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 464/939] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Aug 31 05:06:59 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:06:59.832664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.852706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:59.874147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe8adb-4ae1-4474-9469-4c7ce28ae098 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.885413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:06:59.907249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.907851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.908125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.908396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.909017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:59.909412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:59.910892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:59.915721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 476/940] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:59.916489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:06:59.935278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c924-1aa1-4b66-8325-3e1fa736cb80 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:06:59.977515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:06:59.978156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:06:59.978436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:06:59.978705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:06:59.979460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:06:59.979759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:06:59.981405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:06:59.995415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 465/941] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:06:59.996175 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.034714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44b7af-f52e-4da7-9024-7a929c9383cc None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.076815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.077493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.077776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.078042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.078695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:00.078991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.080351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.094083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 477/942] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:00.094808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.101031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:00.115260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783a65b-8ef6-4f2f-8bd0-2da54527fa42 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.136967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:00.153504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.154294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.154632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.154972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.162351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.163889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:07:00.175651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:00.176582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 466/943] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:06:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:00.177555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.211562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42ece9-c7dd-4c7e-8369-61a02c69ae70 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.250604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.251132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.251402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.251665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.252350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:00.252654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.254241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.259551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 478/944] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:07:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:00.265347 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.283909 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a80dc-6050-4a50-a0e4-ed6ad2d78f67 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.317492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.318126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.318408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.318675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.326578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.328313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.333240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:07:00.339744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:00.340745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 467/945] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:07:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:00.341757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.374069 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7488-b9f8-45e9-8cda-84ebc9eefe28 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.385829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:00.412891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.413533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.413810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.414078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.414740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:00.415040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.416447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.434799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 479/946] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:07:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:00.435631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.464032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4900ae3-70b6-4aa4-ba92-cdaa8eadea8d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.512897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.513889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.514333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.515295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.516666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] RBAC: Adding query filter params (interface=public, service_id=6af1e099da66455ea17e9082aef730b5, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:00.518742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.520217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.531095 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 468/947] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 31 05:07:00 2022] GET /identity/v3/endpoints?service_id=6af1e099da66455ea17e9082aef730b5&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:00.534055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.575423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a93b7-93e9-4b5d-a0bd-f8efbd612e44 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.616257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:00.629268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.629388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.629650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.629916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.630656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:00.630960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.634758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.659271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8faa9-d2f5-4356-8b16-b7a000761a71 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.662367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:00.664304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 480/948] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 31 05:07:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:00.670260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.704471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb784a47-ae85-4912-bc85-d723a2c831cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.705464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784a47-ae85-4912-bc85-d723a2c831cd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.705924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784a47-ae85-4912-bc85-d723a2c831cd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.706480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784a47-ae85-4912-bc85-d723a2c831cd None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.707099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb784a47-ae85-4912-bc85-d723a2c831cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.708479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb784a47-ae85-4912-bc85-d723a2c831cd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.721119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 469/949] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:07:00 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:07:00.794310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbd307-b695-4298-936a-615aba60c88d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:00.831846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:00.832500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:00.832776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:00.833048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:00.844679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:00.846165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:00.862621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:00.863669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:00.864608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:00.864608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:00.864608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:00.864608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 481/950] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:00.871413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb784a47-ae85-4912-bc85-d723a2c831cd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:00.989561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb784a47-ae85-4912-bc85-d723a2c831cd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:01.032077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:01.032704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:01.032988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:01.033299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:01.033956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:01.034283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:01.035709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:01.048990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 470/951] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:01.054557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:01.090566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:01.157940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877411-7ba5-4e27-b90c-b4b2635c2038 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:01.193550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:01.194184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:01.194458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:01.194723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:01.201675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:01.203100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:07:01.214549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:01.215593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:01.216779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 482/952] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:07:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:01.226209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:01.257761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:01.336815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec87d8b-5437-4e09-a5a8-f981fe103eae None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:01.371685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c27d9-ef8d-4462-ac17-8b6575500676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:01.372300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c27d9-ef8d-4462-ac17-8b6575500676 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:01.372580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c27d9-ef8d-4462-ac17-8b6575500676 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:01.372852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c27d9-ef8d-4462-ac17-8b6575500676 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:01.373579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c27d9-ef8d-4462-ac17-8b6575500676 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:01.373886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c27d9-ef8d-4462-ac17-8b6575500676 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:01.375323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c27d9-ef8d-4462-ac17-8b6575500676 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:01.388139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 471/953] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:07:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:01.394551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:01.497133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:01.509134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfa70f-2c38-4a17-b08b-376974fcdb12 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:01.544909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e3db7-1b17-4df1-a24e-6489bc112865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:01.545970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e3db7-1b17-4df1-a24e-6489bc112865 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:01.546485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e3db7-1b17-4df1-a24e-6489bc112865 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:01.546985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e3db7-1b17-4df1-a24e-6489bc112865 None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/ed29db7bc9ab441eb53fdbdcfd656c3d/roles/69e45fcb7ca44ff3987645cbecb19ebb` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:01.549375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e3db7-1b17-4df1-a24e-6489bc112865 None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=ed29db7bc9ab441eb53fdbdcfd656c3d, role_id=69e45fcb7ca44ff3987645cbecb19ebb)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:01.551061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e3db7-1b17-4df1-a24e-6489bc112865 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:01.567785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 483/954] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:07:01 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/ed29db7bc9ab441eb53fdbdcfd656c3d/roles/69e45fcb7ca44ff3987645cbecb19ebb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:07:01.891851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23f327-c1eb-4078-bbb2-819d402376f8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:01.892365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23f327-c1eb-4078-bbb2-819d402376f8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:01.892365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23f327-c1eb-4078-bbb2-819d402376f8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:01.894003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 472/955] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:01.899161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e097b-a3a7-4fc3-90c9-280cea33d15f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:01.899573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e097b-a3a7-4fc3-90c9-280cea33d15f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:01.899770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e097b-a3a7-4fc3-90c9-280cea33d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:01.918390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ad9e097b-a3a7-4fc3-90c9-280cea33d15f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:01.919583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ad9e097b-a3a7-4fc3-90c9-280cea33d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:01.991937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 484/956] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:02.257347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23f327-c1eb-4078-bbb2-819d402376f8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:02.355670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:02.369423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23f327-c1eb-4078-bbb2-819d402376f8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:02.403979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45db32-8eef-41f1-943f-1ee5008ac7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:02.404647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45db32-8eef-41f1-943f-1ee5008ac7b1 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:02.404975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45db32-8eef-41f1-943f-1ee5008ac7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:02.405278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45db32-8eef-41f1-943f-1ee5008ac7b1 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:02.405952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45db32-8eef-41f1-943f-1ee5008ac7b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:02.407335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45db32-8eef-41f1-943f-1ee5008ac7b1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:02.425280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 473/957] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:07:02 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:02.488757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd3ff-b9b3-4841-9d42-82359d5ca6e9 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:02.489142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd3ff-b9b3-4841-9d42-82359d5ca6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:02.489336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcd3ff-b9b3-4841-9d42-82359d5ca6e9 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:02.491035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 485/958] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:02.496622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4d915-7144-4983-bd4f-40a29363d32a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:02.496931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4d915-7144-4983-bd4f-40a29363d32a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:02.497207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4d915-7144-4983-bd4f-40a29363d32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:02.517125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-95b4d915-7144-4983-bd4f-40a29363d32a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:02.518571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-95b4d915-7144-4983-bd4f-40a29363d32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:02.600871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 474/959] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:02.750040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b7e03-b9fd-4eed-b173-01d6180292ad None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:02.750315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b7e03-b9fd-4eed-b173-01d6180292ad None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:02.750589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b7e03-b9fd-4eed-b173-01d6180292ad None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:02.752222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 486/960] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:02.758206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f42e-3e07-409d-b709-752d3c792e34 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:02.758491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f42e-3e07-409d-b709-752d3c792e34 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:02.758764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65f42e-3e07-409d-b709-752d3c792e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:02.778068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4e65f42e-3e07-409d-b709-752d3c792e34 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:02.779193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4e65f42e-3e07-409d-b709-752d3c792e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:02.852884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 475/961] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:02.874726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b7e03-b9fd-4eed-b173-01d6180292ad None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:02.965611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:02.984820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b7e03-b9fd-4eed-b173-01d6180292ad None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:03.021510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:03.022121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.022404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.022672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.023319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:03.024748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:03.027368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING keystone.server.flask.common [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 05:07:03.041897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.sql.core [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 05:07:03.041897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 05:07:03.041897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [parameters: {'user_id': '1ad1ae6bea8b46d797cc6f17c0d31258', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 05:07:03.041897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81574) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application conn.query(q) Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result.read() Aug 31 05:07:03.049126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 05:07:03.050322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application next(self.gen) Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application yield resource Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application next(self.gen) Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise self.value Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application session.commit() Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 05:07:03.051367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.session.flush() Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application compat.raise_( Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 05:07:03.052301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 05:07:03.053300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application conn.query(q) Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application result.read() Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 05:07:03.054226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [parameters: {'user_id': '1ad1ae6bea8b46d797cc6f17c0d31258', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:03.055118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 05:07:03.055993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 05:07:03.057005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 05:07:03.057005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 05:07:03.057005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 05:07:03.057005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 05:07:03.057005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 05:07:03.057005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:03.057005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 487/962] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Aug 31 05:07:02 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:03.064399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f42e-3e07-409d-b709-752d3c792e34 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:03.068723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:03.126572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:03.173344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65f42e-3e07-409d-b709-752d3c792e34 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:03.209791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:03.210827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.211421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.211915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.220143 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:03.221926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:07:03.234662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:03.235678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 05:07:03.236700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:03.237308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec941ff-acf3-47aa-9167-ef0532ca82e5 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:03.239521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 476/963] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:07:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:03.248617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:03.275935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:03.276581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.276861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.277160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.277757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:03.279474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:03.289910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:03.291026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:03.291960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:03.296179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 488/964] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:07:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:03.297415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:03.317011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:03.326691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:03.369478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a57f8-c3e1-4164-844d-ba828a5997f8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:03.406958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:03.407934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.408415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.408914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.409929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:03.410450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:03.412089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:03.432338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7108af-4cda-417b-b2fa-3d129993a522 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:03.450211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 477/965] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Aug 31 05:07:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:03.471671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a196d0-443b-4802-b68f-3247f8fd2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:03.472354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a196d0-443b-4802-b68f-3247f8fd2a61 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.472629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a196d0-443b-4802-b68f-3247f8fd2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.472893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a196d0-443b-4802-b68f-3247f8fd2a61 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.473576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a196d0-443b-4802-b68f-3247f8fd2a61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:03.473940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a196d0-443b-4802-b68f-3247f8fd2a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:03.475412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a196d0-443b-4802-b68f-3247f8fd2a61 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:03.484690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 489/966] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:07:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:03.493457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:03.525199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139001af-33c9-4ef0-847e-3f40a92b0617 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.525524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139001af-33c9-4ef0-847e-3f40a92b0617 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.525754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139001af-33c9-4ef0-847e-3f40a92b0617 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.527417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 490/967] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:07:03.532934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f02f-51ad-44bd-9b16-1b501842c700 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.533337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f02f-51ad-44bd-9b16-1b501842c700 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.533526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f02f-51ad-44bd-9b16-1b501842c700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.552707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0213f02f-51ad-44bd-9b16-1b501842c700 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:03.554223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0213f02f-51ad-44bd-9b16-1b501842c700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:03.618866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944146ec-9372-49aa-8b23-4fb63e604a81 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:03.649052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:03.651951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 491/968] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:07:03.668614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:03.669320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.669603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.669931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.670573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:03.670884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:03.672314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:03.678925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 478/969] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:07:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:03.683741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213f02f-51ad-44bd-9b16-1b501842c700 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:03.693932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:03.795220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213f02f-51ad-44bd-9b16-1b501842c700 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:03.829672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1b6a1-32d6-4e50-8f0a-d5ea05817db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:03.830268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b6a1-32d6-4e50-8f0a-d5ea05817db4 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:03.830538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b6a1-32d6-4e50-8f0a-d5ea05817db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:03.830803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b6a1-32d6-4e50-8f0a-d5ea05817db4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:03.831484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1b6a1-32d6-4e50-8f0a-d5ea05817db4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:03.832824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1b6a1-32d6-4e50-8f0a-d5ea05817db4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:03.853441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 492/970] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:07:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:07:03.934521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:04.050115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab9fb-179e-4670-a680-e5d430bc42e9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:04.089530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73de4f-be0d-497d-b150-c479fc5525e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:04.090159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73de4f-be0d-497d-b150-c479fc5525e9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:04.090411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73de4f-be0d-497d-b150-c479fc5525e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:04.090654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73de4f-be0d-497d-b150-c479fc5525e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:04.103713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73de4f-be0d-497d-b150-c479fc5525e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1e73de4f-be0d-497d-b150-c479fc5525e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:04.108475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:04.109472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:04.110360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 479/971] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 31 05:07:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:04.115956 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1b6a1-32d6-4e50-8f0a-d5ea05817db4 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:04.182189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:04.225106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1b6a1-32d6-4e50-8f0a-d5ea05817db4 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:04.260498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:04.261132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:04.261422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:04.261710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:04.262379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:04.262680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:04.264038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:04.273568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 493/972] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 31 05:07:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:04.279042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73de4f-be0d-497d-b150-c479fc5525e9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:04.324079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:04.381642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73de4f-be0d-497d-b150-c479fc5525e9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:04.416811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba01475-8385-4d64-a5dc-5cf5b8ffd4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:04.417476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba01475-8385-4d64-a5dc-5cf5b8ffd4da None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:04.417720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba01475-8385-4d64-a5dc-5cf5b8ffd4da None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:04.418012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba01475-8385-4d64-a5dc-5cf5b8ffd4da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:04.428957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba01475-8385-4d64-a5dc-5cf5b8ffd4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:04.430426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba01475-8385-4d64-a5dc-5cf5b8ffd4da None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-aba01475-8385-4d64-a5dc-5cf5b8ffd4da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:04.445317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:04.446330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:04.447303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:04.447303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:04.447303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:04.449470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 480/973] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:04.452239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:04.511635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27724cc3-5c15-40ff-8732-56af4a9b549f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:04.512008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27724cc3-5c15-40ff-8732-56af4a9b549f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:04.512200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27724cc3-5c15-40ff-8732-56af4a9b549f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:04.513639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 481/974] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:07:04.519763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869901-cc39-4632-8baf-ca468982ddc2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:04.520362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869901-cc39-4632-8baf-ca468982ddc2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:04.520643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869901-cc39-4632-8baf-ca468982ddc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:04.543763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-26869901-cc39-4632-8baf-ca468982ddc2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:04.545028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26869901-cc39-4632-8baf-ca468982ddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:04.557711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3e326-a862-464e-b488-cf2e045fd95a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:04.583994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:04.595508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:04.596140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:04.596417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:04.596682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:04.597686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:04.598104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:04.599386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:04.612353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 494/975] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:04.621200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:04.629198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 482/976] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:04.728654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378bcf5-eabc-423d-a22b-9fff5d441863 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:04.765362 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:04.765996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:04.766274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:04.766544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:04.774042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:04.775480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:07:04.787249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:04.788231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:04.794353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 495/977] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:07:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:04.795120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26869901-cc39-4632-8baf-ca468982ddc2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:04.819780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:04.886275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:04.897600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26869901-cc39-4632-8baf-ca468982ddc2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:04.931773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:04.933182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:04.933779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:04.934047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:04.934781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:04.935084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:04.936537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:04.940053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:04.959268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 483/978] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Aug 31 05:07:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:04.960397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.003882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75397a-b90f-4051-839f-b9ecb65f9f21 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.038030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.038656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.038934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.039199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] PATH_INFO: `/v3/services/compute` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.039772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.041150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.047910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:05.049902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:05.051154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:05.052073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 496/979] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:07:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:05.057304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.072328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80b7e-5c4b-407b-9a87-4fb900cf2b9a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.106864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623594-5086-4a0a-81e0-62b5f8973889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.107472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623594-5086-4a0a-81e0-62b5f8973889 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.107742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623594-5086-4a0a-81e0-62b5f8973889 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.108015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b623594-5086-4a0a-81e0-62b5f8973889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.166374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0e84-2cdb-424a-aee5-4df56cd6b0be None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.175766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:05.181073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b623594-5086-4a0a-81e0-62b5f8973889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.182655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b623594-5086-4a0a-81e0-62b5f8973889 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.201667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.202271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.202546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.202812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.203435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] RBAC: Adding query filter params (name=compute) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:05.203729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.205065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.214425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 497/980] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:07:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:05.216184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.271604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:05.294887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 484/981] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:04 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:05.300474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623594-5086-4a0a-81e0-62b5f8973889 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.327394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c5394-7458-4dfc-8926-45fbe8eb44ff None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.365381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.365989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.366270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.366539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.367165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:05.367457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.368800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.378772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 498/982] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:07:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:05.379975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.413845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b623594-5086-4a0a-81e0-62b5f8973889 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.415878 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:05.450836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.451732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.452010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.452279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.465364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.467549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.484612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c19d0-0e1f-4baa-8379-536ff9e99c84 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:05.485284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:05.486444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:05.487467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:05.487467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:05.487467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:05.487467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 485/983] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:05.492073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.526042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.526658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.527011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.527331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.528103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] RBAC: Adding query filter params (interface=public, service_id=e100c4f368624f9f8e96515b77323a84, region_id=RegionOne) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:05.528465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.529905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.530799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:05.542410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 499/984] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 31 05:07:05 2022] GET /identity/v3/endpoints?service_id=e100c4f368624f9f8e96515b77323a84&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:05.543536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.612146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc1255-10f0-4d52-b2e7-77492e042720 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.652594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.652819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:05.653504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.654263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.654604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.655551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:05.655709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722fe86-15d4-441c-ac06-8fceb909f66b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.655981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.657470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.670182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 486/985] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:05.675635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.694860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b77b5-cd7f-452a-961c-2178ed2036be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.695549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b77b5-cd7f-452a-961c-2178ed2036be None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.695893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b77b5-cd7f-452a-961c-2178ed2036be None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.696220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b77b5-cd7f-452a-961c-2178ed2036be None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.696881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b77b5-cd7f-452a-961c-2178ed2036be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.698571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b77b5-cd7f-452a-961c-2178ed2036be None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.717118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 500/986] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:07:05 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:07:05.800294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:05.809054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23887-e34a-41be-908a-f8037fb518d4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:05.809681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986e5c6-6076-49f2-b752-2ae3d4f79002 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.809965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986e5c6-6076-49f2-b752-2ae3d4f79002 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.810239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986e5c6-6076-49f2-b752-2ae3d4f79002 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.812402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 501/987] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:07:05.818242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910b70-e04d-4bee-8418-2ee4c7e40b31 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.818512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910b70-e04d-4bee-8418-2ee4c7e40b31 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.818789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910b70-e04d-4bee-8418-2ee4c7e40b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.841380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-25910b70-e04d-4bee-8418-2ee4c7e40b31 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:05.842600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-25910b70-e04d-4bee-8418-2ee4c7e40b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:05.852199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:05.853035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:05.853424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:05.854152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:05.863581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:05.865218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:07:05.878519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:05.880163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:05.882121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 487/988] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:05.886419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:05.936790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 502/989] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:07:05.998359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf1e6a-ebac-43dd-a9d1-f071bb7d9fde None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:06.036370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:06.037000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:06.037332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:06.037629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:06.038412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:06.038749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:06.040235 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:06.054424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 488/990] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:06.060378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25910b70-e04d-4bee-8418-2ee4c7e40b31 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:06.172931 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:06.182158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25910b70-e04d-4bee-8418-2ee4c7e40b31 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:06.217065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:06.221655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:06.222530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:06.222809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:06.223075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:06.223832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] RBAC: Adding query filter params (role.id=69e45fcb7ca44ff3987645cbecb19ebb, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=ed29db7bc9ab441eb53fdbdcfd656c3d) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:06.224139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:06.225585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:06.231995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 503/991] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:06 2022] GET /identity/v3/role_assignments?user.id=ed29db7bc9ab441eb53fdbdcfd656c3d&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=69e45fcb7ca44ff3987645cbecb19ebb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:06.237145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:06.337070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23528ec9-7b6e-4d26-addb-61e81c1e78d3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:06.378271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:06.381007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:06.381007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:06.381007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:06.381007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:06.382110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:06.392773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:06.394129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:06.395205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:06.397126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 489/992] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:07:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:06.404209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:06.527224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa0387-eb7b-48bf-8a07-cf63c7f6feea None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:06.569157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339711-c714-4706-be68-3896d013206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:06.569829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339711-c714-4706-be68-3896d013206f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:06.570085 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339711-c714-4706-be68-3896d013206f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:06.570367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339711-c714-4706-be68-3896d013206f None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:06.571336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339711-c714-4706-be68-3896d013206f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:06.571722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339711-c714-4706-be68-3896d013206f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:06.573080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339711-c714-4706-be68-3896d013206f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:06.585179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 504/993] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:07:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:06.586463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:06.703689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:06.730174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d8d14-1ef9-4528-9e14-ca6ea26dc51e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:06.768563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:06.769493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:06.769975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:06.770282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:06.770923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:06.771223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:06.772598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:06.778635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 490/994] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:07:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:06.784665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339711-c714-4706-be68-3896d013206f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:06.811507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:06.894055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339711-c714-4706-be68-3896d013206f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:06.928378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166813-5605-46b8-b275-7754addafcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:06.928987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166813-5605-46b8-b275-7754addafcdf None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:06.929292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166813-5605-46b8-b275-7754addafcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:06.929559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166813-5605-46b8-b275-7754addafcdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:06.930287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166813-5605-46b8-b275-7754addafcdf None admin] RBAC: Adding query filter params (interface=admin, service_id=6af1e099da66455ea17e9082aef730b5, region_id=RegionOne) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:06.930594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166813-5605-46b8-b275-7754addafcdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:06.931972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166813-5605-46b8-b275-7754addafcdf None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:06.937470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 505/995] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Aug 31 05:07:06 2022] GET /identity/v3/endpoints?service_id=6af1e099da66455ea17e9082aef730b5&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:06.943121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:07.050790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b5bff-e8a7-4adb-9c21-7419f0f1b3a3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:07.084814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eabd26-e325-4395-a7dd-89a9b487cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:07.085574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabd26-e325-4395-a7dd-89a9b487cb2e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:07.085859 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabd26-e325-4395-a7dd-89a9b487cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:07.086132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eabd26-e325-4395-a7dd-89a9b487cb2e None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:07.086733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eabd26-e325-4395-a7dd-89a9b487cb2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:07.088101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eabd26-e325-4395-a7dd-89a9b487cb2e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:07.094544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 491/996] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:07:06 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:07:07.702428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb89ea-f60b-4e83-bba0-cf058887ccbc None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:07.702965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb89ea-f60b-4e83-bba0-cf058887ccbc None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:07.702965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb89ea-f60b-4e83-bba0-cf058887ccbc None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:07.704268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 506/997] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:07.709746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a97e-ab6c-49e5-9423-c750ab178062 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:07.710168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a97e-ab6c-49e5-9423-c750ab178062 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:07.710245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3a97e-ab6c-49e5-9423-c750ab178062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:07.723360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:07.729588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-15e3a97e-ab6c-49e5-9423-c750ab178062 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:07.730803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-15e3a97e-ab6c-49e5-9423-c750ab178062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:07.801117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 492/998] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:08.064435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb89ea-f60b-4e83-bba0-cf058887ccbc None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:08.156442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:08.174859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb89ea-f60b-4e83-bba0-cf058887ccbc None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:08.209549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db35e-9b23-44a5-9dd9-79f3abf93020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:08.210242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db35e-9b23-44a5-9dd9-79f3abf93020 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.210522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db35e-9b23-44a5-9dd9-79f3abf93020 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.210789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db35e-9b23-44a5-9dd9-79f3abf93020 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.211366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db35e-9b23-44a5-9dd9-79f3abf93020 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:08.212757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db35e-9b23-44a5-9dd9-79f3abf93020 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:08.220987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a3e2-66f9-4d66-a311-38037f0485a6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.221309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a3e2-66f9-4d66-a311-38037f0485a6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.221588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93a3e2-66f9-4d66-a311-38037f0485a6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-5f8db35e-9b23-44a5-9dd9-79f3abf93020 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:08.221929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:08.222909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 05:07:08.223804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:08.224582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 493/999] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:08.228015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 507/1000] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:07:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:08.229363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93a3e2-66f9-4d66-a311-38037f0485a6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:08.229874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536a09d-cda5-4108-a543-2e5b030b261e None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.230195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536a09d-cda5-4108-a543-2e5b030b261e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.230421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536a09d-cda5-4108-a543-2e5b030b261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.247987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a536a09d-cda5-4108-a543-2e5b030b261e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:08.249176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a536a09d-cda5-4108-a543-2e5b030b261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:08.321377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 508/1001] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:08.342220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93a3e2-66f9-4d66-a311-38037f0485a6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:08.376655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:08.377553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.378123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.378587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.379389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:08.379868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:08.381560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:08.383812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:08.389405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 494/1002] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:07:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:08.393554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536a09d-cda5-4108-a543-2e5b030b261e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:08.477388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:08.498068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536a09d-cda5-4108-a543-2e5b030b261e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:08.532460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:08.533067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.533379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.533648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.534318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:08.534662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:08.536257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:08.541448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 509/1003] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Aug 31 05:07:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:08.547227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:08.586164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:08.666486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274b7f-7ce3-4c1c-a728-2c347dd00491 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:08.700602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea2f1-abf5-4ee3-bda0-ecd470d5c860 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:08.703495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131fff8-ffeb-454d-a82e-53fd9b90f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:08.703630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131fff8-ffeb-454d-a82e-53fd9b90f490 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.703829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131fff8-ffeb-454d-a82e-53fd9b90f490 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.704094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131fff8-ffeb-454d-a82e-53fd9b90f490 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.704761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131fff8-ffeb-454d-a82e-53fd9b90f490 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:08.706237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131fff8-ffeb-454d-a82e-53fd9b90f490 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:08.728939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 495/1004] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:07:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:08.756840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:08.757573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.758021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.758268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] PATH_INFO: `/v3/services/image` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.758958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:08.760442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:08.771298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:08.772440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:08.774415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 510/1005] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 31 05:07:08 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:08.778837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131fff8-ffeb-454d-a82e-53fd9b90f490 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:08.847003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:08.900267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131fff8-ffeb-454d-a82e-53fd9b90f490 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:08.936414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b3f56-99cc-4604-b4e7-50cbcacb0809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:08.937018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3f56-99cc-4604-b4e7-50cbcacb0809 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.937327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3f56-99cc-4604-b4e7-50cbcacb0809 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.937599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b3f56-99cc-4604-b4e7-50cbcacb0809 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.938251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b3f56-99cc-4604-b4e7-50cbcacb0809 None admin] RBAC: Adding query filter params (name=image) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:08.938548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b3f56-99cc-4604-b4e7-50cbcacb0809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:08.939919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b3f56-99cc-4604-b4e7-50cbcacb0809 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:08.946421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 496/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:08.952484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:08.958263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:08.996796 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2705-8d3d-44d2-b478-6076a4de490f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:08.997215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2705-8d3d-44d2-b478-6076a4de490f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:08.997561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2705-8d3d-44d2-b478-6076a4de490f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:08.999438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 497/1007] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:07:09.005226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50dca8-d0bd-40ff-a258-4401355d9fb0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:09.005515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50dca8-d0bd-40ff-a258-4401355d9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:09.005800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50dca8-d0bd-40ff-a258-4401355d9fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:09.024825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4e50dca8-d0bd-40ff-a258-4401355d9fb0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:09.026044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4e50dca8-d0bd-40ff-a258-4401355d9fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:09.062993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e940da-d82f-4d63-b8b7-70f97207c36d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:09.097939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 498/1008] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:09 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:09.098123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:09.098621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:09.098896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:09.099160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:09.099780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] RBAC: Adding query filter params (type=image) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:09.100074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:09.101448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:09.113139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 511/1009] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:09.361417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50dca8-d0bd-40ff-a258-4401355d9fb0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:09.412727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:09.463818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50dca8-d0bd-40ff-a258-4401355d9fb0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:09.498169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:09.498802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:09.499072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:09.499334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:09.499936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:09.501332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:09.510053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:09.511159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:09.512056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 499/1010] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Aug 31 05:07:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:09.517542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:09.586217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:09.621476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8824d-5294-4636-94ea-1524eadf410c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:09.655901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:09.656507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:09.656754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:09.657052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:09.657705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:09.657998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:09.659378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:09.668869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 512/1011] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:07:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:09.670525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:09.776973 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c072-c63a-43c4-999e-4540701ae4b9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:09.791990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:09.812832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8139c1-494f-48ca-b0c7-8f73a7b8667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:09.813472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8139c1-494f-48ca-b0c7-8f73a7b8667d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:09.813752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8139c1-494f-48ca-b0c7-8f73a7b8667d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:09.814019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8139c1-494f-48ca-b0c7-8f73a7b8667d None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:09.814647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8139c1-494f-48ca-b0c7-8f73a7b8667d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:09.814946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8139c1-494f-48ca-b0c7-8f73a7b8667d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:09.816559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8139c1-494f-48ca-b0c7-8f73a7b8667d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:09.821498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 500/1012] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Aug 31 05:07:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:09.827401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:09.933986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f66746-ffc7-4a36-b419-ae07c32384f4 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:09.964091 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:09.970787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb557-c37f-400a-a1fa-1b4fbb21a059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:09.971433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb557-c37f-400a-a1fa-1b4fbb21a059 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:09.971729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb557-c37f-400a-a1fa-1b4fbb21a059 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:09.972022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb557-c37f-400a-a1fa-1b4fbb21a059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:09.972747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb557-c37f-400a-a1fa-1b4fbb21a059 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:09.974125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb557-c37f-400a-a1fa-1b4fbb21a059 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:09.997116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 513/1013] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:07:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:10.733522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950033-7a74-47f3-87b0-63bded7ee192 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:10.733864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950033-7a74-47f3-87b0-63bded7ee192 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:10.734059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c950033-7a74-47f3-87b0-63bded7ee192 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:10.735592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 501/1014] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:10.740896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8070-6ea4-454c-809a-71ef1a0e8371 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:10.741280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8070-6ea4-454c-809a-71ef1a0e8371 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:10.741640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8070-6ea4-454c-809a-71ef1a0e8371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:10.760954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-435d8070-6ea4-454c-809a-71ef1a0e8371 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:10.762186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-435d8070-6ea4-454c-809a-71ef1a0e8371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:10.837568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 514/1015] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:10 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:10.997929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4cd8b-3a2d-4400-abbb-af5f1c179e74 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:10.998456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4cd8b-3a2d-4400-abbb-af5f1c179e74 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:10.998456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4cd8b-3a2d-4400-abbb-af5f1c179e74 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:10.999889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 502/1016] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:11.005009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ee1c-6933-45a2-9d6d-abe6c5ba2955 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.005425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ee1c-6933-45a2-9d6d-abe6c5ba2955 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.005771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700ee1c-6933-45a2-9d6d-abe6c5ba2955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.025261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0700ee1c-6933-45a2-9d6d-abe6c5ba2955 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:11.026469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0700ee1c-6933-45a2-9d6d-abe6c5ba2955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:11.101122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 515/1017] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:11 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:11.101822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4cd8b-3a2d-4400-abbb-af5f1c179e74 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:11.206255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4cd8b-3a2d-4400-abbb-af5f1c179e74 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:11.239098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd57f9a-dc81-49e4-b487-107b2deddb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:11.239725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57f9a-dc81-49e4-b487-107b2deddb7c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.239999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57f9a-dc81-49e4-b487-107b2deddb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.240262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd57f9a-dc81-49e4-b487-107b2deddb7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.250766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd57f9a-dc81-49e4-b487-107b2deddb7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4cd57f9a-dc81-49e4-b487-107b2deddb7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:11.255456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:11.256535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:07:11.257445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:11.261416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 503/1018] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 31 05:07:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:11.262550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700ee1c-6933-45a2-9d6d-abe6c5ba2955 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:11.315594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:11.361696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd57f9a-dc81-49e4-b487-107b2deddb7c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:11.384291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700ee1c-6933-45a2-9d6d-abe6c5ba2955 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:11.404189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:11.422937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:11.423546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.423818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.424086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.424747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:11.425045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:11.426434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:11.440008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 516/1019] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 31 05:07:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:11.441635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:11.472726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd57f9a-dc81-49e4-b487-107b2deddb7c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:11.509623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93559eb-b6db-4f24-8760-1236b7dee5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:11.510164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93559eb-b6db-4f24-8760-1236b7dee5b0 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.510443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93559eb-b6db-4f24-8760-1236b7dee5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.510711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93559eb-b6db-4f24-8760-1236b7dee5b0 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.511396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93559eb-b6db-4f24-8760-1236b7dee5b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:11.512765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93559eb-b6db-4f24-8760-1236b7dee5b0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:11.529716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 504/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:07:11 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:07:11.550216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc58c6-dc33-4352-8a1c-bc4727c233a8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:11.563412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:11.597899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:11.598566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.598845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.599113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.611308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:11.613580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:11.629477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:11.630532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:11.636226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:11.636226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:11.636226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:11.636226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 517/1021] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:11.637782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93559eb-b6db-4f24-8760-1236b7dee5b0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:11.754102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:11.758512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93559eb-b6db-4f24-8760-1236b7dee5b0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:11.795569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eea3b2-e4f1-4d79-bcbe-5de1ec513060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:11.796098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea3b2-e4f1-4d79-bcbe-5de1ec513060 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.796372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea3b2-e4f1-4d79-bcbe-5de1ec513060 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.796641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea3b2-e4f1-4d79-bcbe-5de1ec513060 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.797310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eea3b2-e4f1-4d79-bcbe-5de1ec513060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:11.797611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eea3b2-e4f1-4d79-bcbe-5de1ec513060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:11.798982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eea3b2-e4f1-4d79-bcbe-5de1ec513060 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:11.812177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 505/1022] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:11.817895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:11.888245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d538e-4afa-45dd-afb5-93b1f201ed6e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.888564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d538e-4afa-45dd-afb5-93b1f201ed6e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.888899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d538e-4afa-45dd-afb5-93b1f201ed6e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.890831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 506/1023] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:11.895815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb364c9-cff1-4ae1-9b1d-64e3c7fc1d67 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.896097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb364c9-cff1-4ae1-9b1d-64e3c7fc1d67 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.896370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb364c9-cff1-4ae1-9b1d-64e3c7fc1d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.914381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6fb364c9-cff1-4ae1-9b1d-64e3c7fc1d67 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:11.915570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6fb364c9-cff1-4ae1-9b1d-64e3c7fc1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:11.926362 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e196a2-d5b8-4b8a-b672-558d0c7724ed None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:11.962172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:11.962875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:11.963150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:11.963401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:11.971103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:11.972557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:07:11.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:11.984597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:11.990994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 518/1024] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:07:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:11.991666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 507/1025] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:07:11.994149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:12.017194 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:12.099053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ef41f-c826-4699-8e0b-b5cbcc3232b3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:12.133537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:12.134144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:12.134422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:12.134688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:12.135407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:12.135710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:12.137109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:12.159554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 519/1026] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:07:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:12.161014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb364c9-cff1-4ae1-9b1d-64e3c7fc1d67 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:12.252543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:12.256166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:12.267787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb364c9-cff1-4ae1-9b1d-64e3c7fc1d67 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:12.303763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2849f-423a-4cfa-b836-715c4ec209f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:12.304363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2849f-423a-4cfa-b836-715c4ec209f8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:12.304641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2849f-423a-4cfa-b836-715c4ec209f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:12.304908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2849f-423a-4cfa-b836-715c4ec209f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:12.340767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:12.364681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2b248-66b3-43d7-8299-134bf8d3ac8c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:12.386662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2849f-423a-4cfa-b836-715c4ec209f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:12.388109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2849f-423a-4cfa-b836-715c4ec209f8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:12.401679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37e6ff-7f2a-426f-bea0-f26eac4e46f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:12.402410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37e6ff-7f2a-426f-bea0-f26eac4e46f0 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:12.402690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37e6ff-7f2a-426f-bea0-f26eac4e46f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:12.403170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37e6ff-7f2a-426f-bea0-f26eac4e46f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:12.404074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37e6ff-7f2a-426f-bea0-f26eac4e46f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:12.405540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37e6ff-7f2a-426f-bea0-f26eac4e46f0 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:12.411880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 520/1027] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:12.412908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37e6ff-7f2a-426f-bea0-f26eac4e46f0 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:12.479509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:12.494502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 508/1028] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:12.500122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2849f-423a-4cfa-b836-715c4ec209f8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:12.525110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37e6ff-7f2a-426f-bea0-f26eac4e46f0 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:12.565024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc6698-6dc9-4185-8343-58ddd94f1912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:12.565928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6698-6dc9-4185-8343-58ddd94f1912 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:12.566209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6698-6dc9-4185-8343-58ddd94f1912 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:12.566475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6698-6dc9-4185-8343-58ddd94f1912 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:12.567130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc6698-6dc9-4185-8343-58ddd94f1912 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:12.568804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc6698-6dc9-4185-8343-58ddd94f1912 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:12.589310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:12.613189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 521/1029] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:07:12 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:12.613403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2849f-423a-4cfa-b836-715c4ec209f8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:12.653179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:12.653887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:12.654162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:12.654430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:12.667401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:12.668912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:12.685990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:12.687098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:12.693604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:12.693604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:12.693604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:12.693604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 509/1030] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:12.695508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc6698-6dc9-4185-8343-58ddd94f1912 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:12.806077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc6698-6dc9-4185-8343-58ddd94f1912 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:12.841590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:12.842204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:12.842486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:12.842755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:12.843396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:12.843695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:12.845052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:12.857646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 522/1031] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:12.863418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:12.908953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:12.970788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c580487-6c35-4fa5-aaee-fcb3870f7211 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:13.006242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:13.006879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:13.007157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:13.007423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:13.014553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:13.016305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:07:13.027981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:13.028918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:13.029876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:07:13.029876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:07:13.029876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:07:13.029876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:07:13.029876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:07:13.029876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:07:13.029876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:13.029876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:13.033407 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 510/1032] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:13.035107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:13.097506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:13.142525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7b572-2a16-430d-a803-cd285153fa54 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:13.177813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64856a91-f0f3-4902-b9e8-fc6640d8fd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:13.178340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856a91-f0f3-4902-b9e8-fc6640d8fd72 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:13.178618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856a91-f0f3-4902-b9e8-fc6640d8fd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:13.178942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64856a91-f0f3-4902-b9e8-fc6640d8fd72 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:13.179639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64856a91-f0f3-4902-b9e8-fc6640d8fd72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:13.179942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64856a91-f0f3-4902-b9e8-fc6640d8fd72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:13.181382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64856a91-f0f3-4902-b9e8-fc6640d8fd72 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:13.193425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 523/1033] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:07:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:13.199368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:13.298773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:13.302542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efe591-6e8f-4176-b271-d730b911c29f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:13.337824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d60194-2573-45ac-9422-b38d62924eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:13.338500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d60194-2573-45ac-9422-b38d62924eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:13.338783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d60194-2573-45ac-9422-b38d62924eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:13.339060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d60194-2573-45ac-9422-b38d62924eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:13.339785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d60194-2573-45ac-9422-b38d62924eb9 None admin] RBAC: Adding query filter params (role.id=69e45fcb7ca44ff3987645cbecb19ebb, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=7f5576a90945429a9127a2d4c53a729c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:13.340092 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d60194-2573-45ac-9422-b38d62924eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:13.341564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d60194-2573-45ac-9422-b38d62924eb9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:13.347166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 511/1034] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:13 2022] GET /identity/v3/role_assignments?user.id=7f5576a90945429a9127a2d4c53a729c&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=69e45fcb7ca44ff3987645cbecb19ebb => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:13.458677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73df75e-c63d-4678-b03c-a5ed249e4953 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:13.458859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73df75e-c63d-4678-b03c-a5ed249e4953 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:13.459126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73df75e-c63d-4678-b03c-a5ed249e4953 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:13.460566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 524/1035] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:13.466246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3bb9-2217-4411-9691-6465e866293b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:13.466537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3bb9-2217-4411-9691-6465e866293b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:13.466796 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c3bb9-2217-4411-9691-6465e866293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:13.485823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ff0c3bb9-2217-4411-9691-6465e866293b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:13.487036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ff0c3bb9-2217-4411-9691-6465e866293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:13.561178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 512/1036] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:13.817430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73df75e-c63d-4678-b03c-a5ed249e4953 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:13.924274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73df75e-c63d-4678-b03c-a5ed249e4953 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:13.941280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:13.960791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:13.961468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:13.961745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:13.962011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] PATH_INFO: `/v3/services/image` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:13.962569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:13.963993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:13.973301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:13.974358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:13.975248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:13.977444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 525/1037] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 31 05:07:13 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:13.980349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c3bb9-2217-4411-9691-6465e866293b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:14.080448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:14.088954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c3bb9-2217-4411-9691-6465e866293b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:14.123744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:14.124362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:14.124642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:14.124922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:14.125688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] RBAC: Adding query filter params (name=image) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:14.125993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:14.127360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:14.132929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 513/1038] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:14.138614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:14.249997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da917812-5aa2-4974-ad3d-2c3bc64b3dda None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:14.285723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:14.286330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:14.286604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:14.286869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:14.287490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] RBAC: Adding query filter params (type=image) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:14.287787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:14.289164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:14.294339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 526/1039] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:14.300326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:14.404773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12091cf-3849-4d60-b897-65987a90de04 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:14.443629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5b826-880f-4cde-bc3d-61f366d85556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:14.444242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b826-880f-4cde-bc3d-61f366d85556 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:14.444519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b826-880f-4cde-bc3d-61f366d85556 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:14.444789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5b826-880f-4cde-bc3d-61f366d85556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:14.445527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5b826-880f-4cde-bc3d-61f366d85556 None admin] RBAC: Adding query filter params (interface=public, service_id=cce39ea99ac74232a2b608421741c482, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:14.445833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5b826-880f-4cde-bc3d-61f366d85556 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:14.447200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5b826-880f-4cde-bc3d-61f366d85556 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:14.452682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 514/1040] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 31 05:07:14 2022] GET /identity/v3/endpoints?service_id=cce39ea99ac74232a2b608421741c482&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:14.458918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:14.507610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:14.530192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e838a1-5eb9-4db8-ad86-6dacda3970ef None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:14.530530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e838a1-5eb9-4db8-ad86-6dacda3970ef None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:14.530722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e838a1-5eb9-4db8-ad86-6dacda3970ef None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:14.532244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 515/1041] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:07:14.537287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4d9e-f703-47c0-b8e9-8bc7fa729407 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:14.537548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4d9e-f703-47c0-b8e9-8bc7fa729407 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:14.537840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb4d9e-f703-47c0-b8e9-8bc7fa729407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:14.556400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-22bb4d9e-f703-47c0-b8e9-8bc7fa729407 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:14.557602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-22bb4d9e-f703-47c0-b8e9-8bc7fa729407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:14.566870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d4116-a742-44e5-bcc1-3d6745fdb2af None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:14.574588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:14.604141 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712aec-a374-44b8-87c1-4962997a8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:14.604755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712aec-a374-44b8-87c1-4962997a8c44 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:14.605031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712aec-a374-44b8-87c1-4962997a8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:14.605324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712aec-a374-44b8-87c1-4962997a8c44 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:14.605988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee712aec-a374-44b8-87c1-4962997a8c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:14.607347 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee712aec-a374-44b8-87c1-4962997a8c44 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:14.614246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 527/1042] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:07:14 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:07:14.633602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 516/1043] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:07:14.896373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712aec-a374-44b8-87c1-4962997a8c44 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:14.999893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712aec-a374-44b8-87c1-4962997a8c44 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:15.008983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:15.036569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bead40f-3104-4635-9064-f60b16871cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:15.037277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bead40f-3104-4635-9064-f60b16871cfd None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:15.037554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bead40f-3104-4635-9064-f60b16871cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:15.037821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bead40f-3104-4635-9064-f60b16871cfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:15.038906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bead40f-3104-4635-9064-f60b16871cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:15.040330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bead40f-3104-4635-9064-f60b16871cfd None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:15.045128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 528/1044] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:15.047572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb4d9e-f703-47c0-b8e9-8bc7fa729407 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:15.158044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb4d9e-f703-47c0-b8e9-8bc7fa729407 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:15.194889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72144b92-f51f-4e75-a914-7d6f4e4c9446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:15.195501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72144b92-f51f-4e75-a914-7d6f4e4c9446 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:15.195777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72144b92-f51f-4e75-a914-7d6f4e4c9446 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:15.196045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72144b92-f51f-4e75-a914-7d6f4e4c9446 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:15.196694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72144b92-f51f-4e75-a914-7d6f4e4c9446 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:15.198153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72144b92-f51f-4e75-a914-7d6f4e4c9446 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:15.221338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa9f7-0ed8-44e3-a295-06303a1efc1d None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:15.221969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa9f7-0ed8-44e3-a295-06303a1efc1d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:15.221969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fa9f7-0ed8-44e3-a295-06303a1efc1d None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:15.223002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 517/1045] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:07:15 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:15.224083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 529/1046] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:15.230715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450163-2ab0-4a43-972f-6e75aef333c5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:15.231031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450163-2ab0-4a43-972f-6e75aef333c5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:15.231273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450163-2ab0-4a43-972f-6e75aef333c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:15.252212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-60450163-2ab0-4a43-972f-6e75aef333c5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:15.253865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-60450163-2ab0-4a43-972f-6e75aef333c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:15.256362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:15.337899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 518/1047] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:15.600157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fa9f7-0ed8-44e3-a295-06303a1efc1d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:15.720270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fa9f7-0ed8-44e3-a295-06303a1efc1d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:15.755387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac652-9f2f-4f0e-8717-6d5277eb3212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:15.756021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac652-9f2f-4f0e-8717-6d5277eb3212 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:15.756298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac652-9f2f-4f0e-8717-6d5277eb3212 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:15.756567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeac652-9f2f-4f0e-8717-6d5277eb3212 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:15.767346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeac652-9f2f-4f0e-8717-6d5277eb3212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-7aeac652-9f2f-4f0e-8717-6d5277eb3212 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:15.772177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:15.777303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:15.778219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 530/1048] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 31 05:07:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:15.780056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450163-2ab0-4a43-972f-6e75aef333c5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:15.881854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450163-2ab0-4a43-972f-6e75aef333c5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:15.916526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:15.917164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:15.917444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:15.917709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:15.918376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:15.918679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:15.920046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:15.925990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:15.934942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 519/1049] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 31 05:07:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:15.936264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac652-9f2f-4f0e-8717-6d5277eb3212 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:15.976478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:16.043535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeac652-9f2f-4f0e-8717-6d5277eb3212 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:16.096530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:16.097189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:16.097463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:16.097728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:16.114365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:16.115854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:16.132865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:16.134090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:16.135061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:16.135061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:16.135061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:16.137409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 531/1050] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:16.139760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:16.245601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dda18e-f5f7-4015-9a8b-9b05f38a295c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:16.280668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:16.281327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:16.281607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:16.281877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:16.282528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:16.282832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:16.284274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:16.298920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 520/1051] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:16.303256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:16.399029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:16.415778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75703f-5481-4baa-b709-46ce6d62a640 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:16.457678 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0b62b-804d-4f6e-81e7-2b824450e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:16.458318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b62b-804d-4f6e-81e7-2b824450e5cf None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:16.458737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b62b-804d-4f6e-81e7-2b824450e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:16.458938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0b62b-804d-4f6e-81e7-2b824450e5cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:16.467009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0b62b-804d-4f6e-81e7-2b824450e5cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:16.468424 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0b62b-804d-4f6e-81e7-2b824450e5cf None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-63a0b62b-804d-4f6e-81e7-2b824450e5cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:07:16.479863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:16.480818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:16.481857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 532/1052] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:07:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:16.488741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:16.510855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd487-b24a-41b1-bbaa-4f09aab8a46b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:16.511137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd487-b24a-41b1-bbaa-4f09aab8a46b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:16.511413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd487-b24a-41b1-bbaa-4f09aab8a46b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:16.512747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 533/1053] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:07:16.517828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739785d-9462-4da2-9b6f-ad3acd44a9fe None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:16.518105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739785d-9462-4da2-9b6f-ad3acd44a9fe None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:16.518379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739785d-9462-4da2-9b6f-ad3acd44a9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:16.536572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b739785d-9462-4da2-9b6f-ad3acd44a9fe None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:16.537783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b739785d-9462-4da2-9b6f-ad3acd44a9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:16.555789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:16.598671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf0ad-5b39-4403-b568-ab7338506655 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:16.611920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 534/1054] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:07:16.642395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:16.643100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:16.643449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:16.643826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:16.644646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:16.645040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:16.646573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:16.668953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 521/1055] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:07:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:16.670255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739785d-9462-4da2-9b6f-ad3acd44a9fe None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:16.756457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:16.779587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739785d-9462-4da2-9b6f-ad3acd44a9fe None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:16.814704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:16.815417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:16.815805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:16.816115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:16.826407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:16.827828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:16.842367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:16.843380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:16.844881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:16.844881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:16.844881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:16.844881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 535/1056] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:16.849470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:16.891594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:16.954447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0d15c-d919-4448-912e-dc76ad1864b5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:16.973697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:16.992375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:16.992988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:16.993366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:16.993637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:16.994280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:16.994581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:16.995944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:16.997374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01140-52f9-4285-8e18-1185f4132839 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:17.008252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 522/1057] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:17.013977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:17.027260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:17.034690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:17.035554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.035976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.036411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.037300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:17.038845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:17.048838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:17.050184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 05:07:17.051246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:17.053377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 536/1058] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Aug 31 05:07:16 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:17.059372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:17.123678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce1497-b5dc-49e8-a4ce-0f63c7705626 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:17.162775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:17.163410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.163688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.163952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.164048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5a6a-441c-42ac-8960-0de5654bf4f6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:17.171202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:17.172638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:07:17.184186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:17.185133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:17.186070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 523/1059] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:17.191137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:17.202805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037fc71-35d1-483b-8726-c2fae60b6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:17.203441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037fc71-35d1-483b-8726-c2fae60b6eba None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.204017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037fc71-35d1-483b-8726-c2fae60b6eba None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.204284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037fc71-35d1-483b-8726-c2fae60b6eba None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.205138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037fc71-35d1-483b-8726-c2fae60b6eba None admin] RBAC: Adding query filter params (name=image) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:17.205511 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037fc71-35d1-483b-8726-c2fae60b6eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:17.207152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037fc71-35d1-483b-8726-c2fae60b6eba None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:17.212656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 537/1060] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:17.215015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882c92-ead2-42d9-bf9a-ba1511cffcbe None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.215305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882c92-ead2-42d9-bf9a-ba1511cffcbe None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.215578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882c92-ead2-42d9-bf9a-ba1511cffcbe None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.216810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 538/1061] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:17.218117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882c92-ead2-42d9-bf9a-ba1511cffcbe None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:17.234934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:17.279107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:17.296342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d698dd-7792-4145-a2b3-af470d375a9d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:17.321492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882c92-ead2-42d9-bf9a-ba1511cffcbe None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:17.329952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee12eb-4607-4a72-b436-a262557528ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:17.330895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee12eb-4607-4a72-b436-a262557528ca None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.331206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee12eb-4607-4a72-b436-a262557528ca None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.331451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee12eb-4607-4a72-b436-a262557528ca None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.332440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee12eb-4607-4a72-b436-a262557528ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:17.332747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee12eb-4607-4a72-b436-a262557528ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:17.334210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee12eb-4607-4a72-b436-a262557528ca None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:17.345871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 524/1062] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:17.345871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433a6a-addf-4934-9ad1-61d9b043a172 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.345871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433a6a-addf-4934-9ad1-61d9b043a172 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.345871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433a6a-addf-4934-9ad1-61d9b043a172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.357133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:17.357746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.358025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.358296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.358929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] RBAC: Adding query filter params (type=image) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:17.359236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:17.360633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:17.365107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-de433a6a-addf-4934-9ad1-61d9b043a172 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:17.365576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 539/1063] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:17.366317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-de433a6a-addf-4934-9ad1-61d9b043a172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:17.366435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:17.431903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 525/1064] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:17.432714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de433a6a-addf-4934-9ad1-61d9b043a172 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:17.466386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e42d8-7dd1-4f50-a8a5-48efd5a9238e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:17.468253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:17.495711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:17.510708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265f8e1-c421-47ce-98c4-e53d4af04533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:17.511369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265f8e1-c421-47ce-98c4-e53d4af04533 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.511874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265f8e1-c421-47ce-98c4-e53d4af04533 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.512146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265f8e1-c421-47ce-98c4-e53d4af04533 None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/7f5576a90945429a9127a2d4c53a729c/roles/69e45fcb7ca44ff3987645cbecb19ebb` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.515429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265f8e1-c421-47ce-98c4-e53d4af04533 None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=7f5576a90945429a9127a2d4c53a729c, role_id=69e45fcb7ca44ff3987645cbecb19ebb)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:17.516866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265f8e1-c421-47ce-98c4-e53d4af04533 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:17.534403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 540/1065] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:07:17 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/7f5576a90945429a9127a2d4c53a729c/roles/69e45fcb7ca44ff3987645cbecb19ebb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:07:17.544306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de433a6a-addf-4934-9ad1-61d9b043a172 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:17.584546 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1fa6e-9b3a-4add-8f36-f18c0c265d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:17.585703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fa6e-9b3a-4add-8f36-f18c0c265d2b None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.586191 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fa6e-9b3a-4add-8f36-f18c0c265d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.586668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fa6e-9b3a-4add-8f36-f18c0c265d2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.587574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1fa6e-9b3a-4add-8f36-f18c0c265d2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:17.589259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1fa6e-9b3a-4add-8f36-f18c0c265d2b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:17.612963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 526/1066] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:07:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:17.700151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265f8e1-c421-47ce-98c4-e53d4af04533 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:17.809356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265f8e1-c421-47ce-98c4-e53d4af04533 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:17.849552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e9a5-255a-4b0a-858e-23696b7ed5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:17.850193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e9a5-255a-4b0a-858e-23696b7ed5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:17.850471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e9a5-255a-4b0a-858e-23696b7ed5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:17.850741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e9a5-255a-4b0a-858e-23696b7ed5f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:17.861160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39e9a5-255a-4b0a-858e-23696b7ed5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-aa39e9a5-255a-4b0a-858e-23696b7ed5f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:17.866187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:17.867183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:17.868077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 541/1067] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:07:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:17.877136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1fa6e-9b3a-4add-8f36-f18c0c265d2b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:17.964861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:17.983309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1fa6e-9b3a-4add-8f36-f18c0c265d2b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:18.019021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:18.019636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:18.019907 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:18.020174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:18.020832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:18.021139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:18.022574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:18.031468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 527/1068] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:18.037407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e9a5-255a-4b0a-858e-23696b7ed5f8 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:18.077677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:18.150862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e9a5-255a-4b0a-858e-23696b7ed5f8 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:18.185956 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664cd46-1975-4435-b668-9c3e7bbcbbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:18.186628 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664cd46-1975-4435-b668-9c3e7bbcbbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:18.186905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664cd46-1975-4435-b668-9c3e7bbcbbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:18.187170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664cd46-1975-4435-b668-9c3e7bbcbbf2 None admin] PATH_INFO: `/v3/users/7506893acc2a491884578681539d46fd` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:18.200902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664cd46-1975-4435-b668-9c3e7bbcbbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=7506893acc2a491884578681539d46fd)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:18.202351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664cd46-1975-4435-b668-9c3e7bbcbbf2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:18.208997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 542/1069] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:18 2022] GET /identity/v3/users/7506893acc2a491884578681539d46fd => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:18.211071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:18.309745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3f14d-75d8-4f97-9221-6a9299d36f24 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:18.343107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412349c8-c3de-4efa-91fc-77fcc4e8b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:18.343643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412349c8-c3de-4efa-91fc-77fcc4e8b4ac None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:18.343916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412349c8-c3de-4efa-91fc-77fcc4e8b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:18.344177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412349c8-c3de-4efa-91fc-77fcc4e8b4ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:18.359023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:18.412452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412349c8-c3de-4efa-91fc-77fcc4e8b4ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:18.413921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412349c8-c3de-4efa-91fc-77fcc4e8b4ac None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:18.521126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 528/1070] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:18.522513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664cd46-1975-4435-b668-9c3e7bbcbbf2 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:18.632192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:18.639485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664cd46-1975-4435-b668-9c3e7bbcbbf2 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:18.675183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7eabf-0abc-454d-9c08-3571e4b53117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:18.675827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7eabf-0abc-454d-9c08-3571e4b53117 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:18.676104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7eabf-0abc-454d-9c08-3571e4b53117 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:18.676377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7eabf-0abc-454d-9c08-3571e4b53117 None admin] PATH_INFO: `/v3/projects/921d90bd56364ad2902a9d72f83b63f8` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:18.677523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7eabf-0abc-454d-9c08-3571e4b53117 None admin] RBAC: Authorizing `identity:get_project(project_id=921d90bd56364ad2902a9d72f83b63f8)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:18.678961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7eabf-0abc-454d-9c08-3571e4b53117 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:18.685656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 543/1071] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:18 2022] GET /identity/v3/projects/921d90bd56364ad2902a9d72f83b63f8 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:18.687194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412349c8-c3de-4efa-91fc-77fcc4e8b4ac None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:18.736603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:18.799710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412349c8-c3de-4efa-91fc-77fcc4e8b4ac None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:18.841386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879b95-8875-45c6-9d2b-1404b53eb442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:18.842055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879b95-8875-45c6-9d2b-1404b53eb442 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:18.842329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879b95-8875-45c6-9d2b-1404b53eb442 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:18.842601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879b95-8875-45c6-9d2b-1404b53eb442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:18.843372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f879b95-8875-45c6-9d2b-1404b53eb442 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=921d90bd56364ad2902a9d72f83b63f8, user.id=7506893acc2a491884578681539d46fd) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:18.843685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f879b95-8875-45c6-9d2b-1404b53eb442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:18.845147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f879b95-8875-45c6-9d2b-1404b53eb442 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:18.857525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 529/1072] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:18 2022] GET /identity/v3/role_assignments?user.id=7506893acc2a491884578681539d46fd&scope.project.id=921d90bd56364ad2902a9d72f83b63f8&role.id=6da07502c09e4fc8afb31b58e434479b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:19.457290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7230f-42b7-4a1e-af85-243fe878d018 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:19.457726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7230f-42b7-4a1e-af85-243fe878d018 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:19.457855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7230f-42b7-4a1e-af85-243fe878d018 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:19.459222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 544/1073] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:19.464481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72449722-a1bb-473b-98f8-959db4d7c198 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:19.464740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72449722-a1bb-473b-98f8-959db4d7c198 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:19.465037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72449722-a1bb-473b-98f8-959db4d7c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:19.491151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-72449722-a1bb-473b-98f8-959db4d7c198 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:19.492347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-72449722-a1bb-473b-98f8-959db4d7c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:19.536357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a685d-d929-4823-990e-447ed6fd8bd5 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:19.536879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a685d-d929-4823-990e-447ed6fd8bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:19.536879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a685d-d929-4823-990e-447ed6fd8bd5 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:19.538387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 545/1074] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:07:19.543040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c573d-88fe-4828-8976-7845963ba377 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:19.543322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c573d-88fe-4828-8976-7845963ba377 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:19.543600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c573d-88fe-4828-8976-7845963ba377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:19.562454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-972c573d-88fe-4828-8976-7845963ba377 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:19.563625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-972c573d-88fe-4828-8976-7845963ba377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:19.564897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 530/1075] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:19.639877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 546/1076] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:07:19.832245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72449722-a1bb-473b-98f8-959db4d7c198 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:19.875967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:19.905391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c573d-88fe-4828-8976-7845963ba377 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:19.941476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72449722-a1bb-473b-98f8-959db4d7c198 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:19.978223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbff10-1101-4fad-886b-4b1688b34a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:19.978856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbff10-1101-4fad-886b-4b1688b34a2c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:19.979205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbff10-1101-4fad-886b-4b1688b34a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:19.979486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbff10-1101-4fad-886b-4b1688b34a2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:19.991387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbff10-1101-4fad-886b-4b1688b34a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4bdbff10-1101-4fad-886b-4b1688b34a2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:19.996432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:19.997474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:19.998625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 531/1077] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Aug 31 05:07:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:20.002388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:20.003710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbff10-1101-4fad-886b-4b1688b34a2c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:20.009934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c573d-88fe-4828-8976-7845963ba377 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:20.044059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89916d09-131d-4f9f-a76a-2e4ffc9674f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:20.044662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89916d09-131d-4f9f-a76a-2e4ffc9674f9 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.044934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89916d09-131d-4f9f-a76a-2e4ffc9674f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.045230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89916d09-131d-4f9f-a76a-2e4ffc9674f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.107942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:20.114474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbff10-1101-4fad-886b-4b1688b34a2c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:20.116309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89916d09-131d-4f9f-a76a-2e4ffc9674f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:20.117802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89916d09-131d-4f9f-a76a-2e4ffc9674f9 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:20.157965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:20.158610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.158892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.159267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.160275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:20.160275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:20.161634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:20.171081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 532/1078] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 31 05:07:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:20.176437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:20.217973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:20.229247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 547/1079] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 05:07:20.234513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89916d09-131d-4f9f-a76a-2e4ffc9674f9 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:20.282273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead3d3-6169-4335-af77-5b857ab7697b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:20.318896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:20.319536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.319817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.320088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.335433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:20.336937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:20.341042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89916d09-131d-4f9f-a76a-2e4ffc9674f9 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:20.352449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:20.353545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:20.354496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:20.354496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:20.354496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:20.354496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 533/1080] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:20.359502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:20.375538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:20.378747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:20.379380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.379657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.379924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.390039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:20.391782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:20.406036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:20.407071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:20.408035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:20.408035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:20.408035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:20.408035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 548/1081] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:20.413291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:20.461159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:20.468224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c05a9-456d-404c-8497-4c42349b2d27 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:20.502745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:20.503558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.503836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.504103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.504743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:20.505042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:20.506429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:20.517933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4938c-335a-499a-a756-b74f826f3395 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:20.523238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 534/1082] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:20.524224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:20.558394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:20.559100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.559445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.559713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.560348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:20.560646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:20.562020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:20.574867 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 549/1083] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:20.615671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:20.652460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01188d09-a240-4769-9fb4-332b53174bd0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:20.694137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19c4c1-39cb-49a8-9b61-354224512c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:20.694788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c4c1-39cb-49a8-9b61-354224512c36 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.695066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c4c1-39cb-49a8-9b61-354224512c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.695328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c4c1-39cb-49a8-9b61-354224512c36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.703613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19c4c1-39cb-49a8-9b61-354224512c36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:20.705072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19c4c1-39cb-49a8-9b61-354224512c36 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ff19c4c1-39cb-49a8-9b61-354224512c36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:07:20.717737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:20.718787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:20.720392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 535/1084] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Aug 31 05:07:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:20.724832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:20.733485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483b973-af13-4328-bbbc-7011569d3216 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.733758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483b973-af13-4328-bbbc-7011569d3216 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.734094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483b973-af13-4328-bbbc-7011569d3216 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.735499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 536/1085] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:07:20.740742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df394812-aef8-484e-a1a5-426c3b972ece None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.741023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df394812-aef8-484e-a1a5-426c3b972ece None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.741322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df394812-aef8-484e-a1a5-426c3b972ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.760700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-df394812-aef8-484e-a1a5-426c3b972ece None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:20.761946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-df394812-aef8-484e-a1a5-426c3b972ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:20.842110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 537/1086] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:20.846354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6fa7c-8ed5-4aef-af90-9d9386dc5e46 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:20.854781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:20.885182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:20.885694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:20.885968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:20.886233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:20.886957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:20.887258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:20.888670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:20.905883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 550/1087] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Aug 31 05:07:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:20.912305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df394812-aef8-484e-a1a5-426c3b972ece None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:20.975965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.014059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df394812-aef8-484e-a1a5-426c3b972ece None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.048652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a67ac5-cc0c-40f1-874b-a1dea1fc5f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.049292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67ac5-cc0c-40f1-874b-a1dea1fc5f3f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.049562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67ac5-cc0c-40f1-874b-a1dea1fc5f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.049895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67ac5-cc0c-40f1-874b-a1dea1fc5f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.102051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.117105 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a67ac5-cc0c-40f1-874b-a1dea1fc5f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.118544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a67ac5-cc0c-40f1-874b-a1dea1fc5f3f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.181295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.201889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf303054-39bc-444b-bb31-8da8e8483b3c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.225951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 538/1088] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:21.227015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a67ac5-cc0c-40f1-874b-a1dea1fc5f3f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.235385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dea8ff-d76c-41d8-a6a8-cf947c109429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.236017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dea8ff-d76c-41d8-a6a8-cf947c109429 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.236278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dea8ff-d76c-41d8-a6a8-cf947c109429 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.236548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dea8ff-d76c-41d8-a6a8-cf947c109429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.246612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dea8ff-d76c-41d8-a6a8-cf947c109429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-86dea8ff-d76c-41d8-a6a8-cf947c109429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:21.251334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:21.252455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:21.253653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 551/1089] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:21.259050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dea8ff-d76c-41d8-a6a8-cf947c109429 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.283474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.328492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a67ac5-cc0c-40f1-874b-a1dea1fc5f3f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.357553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dea8ff-d76c-41d8-a6a8-cf947c109429 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.363103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.363732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.364000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.364264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.374211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.375659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:21.390951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:21.391946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:07:21.392961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:21.392961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:07:21.392961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:21.392961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 539/1090] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:07:21.393986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.394601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.394880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.395150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.395819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:21.396120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.397584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.398430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.410904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 552/1091] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:21.411957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.418144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.497910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.502144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef567c-1abb-47a1-b494-7aab9b5b92a1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.513567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2239d-8d61-4277-bd04-19cc2ec3c26d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.538094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.538706 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.538987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.539253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.539894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:21.540193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.541602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.547149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28105df-7993-46e6-aa6d-45a539b92bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.547773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28105df-7993-46e6-aa6d-45a539b92bee None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.548046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28105df-7993-46e6-aa6d-45a539b92bee None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.548315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28105df-7993-46e6-aa6d-45a539b92bee None admin] PATH_INFO: `/v3/users/7506893acc2a491884578681539d46fd` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.549472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28105df-7993-46e6-aa6d-45a539b92bee None admin] RBAC: Authorizing `identity:get_user(user_id=7506893acc2a491884578681539d46fd)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.551356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28105df-7993-46e6-aa6d-45a539b92bee None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.553126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 553/1092] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/users/7506893acc2a491884578681539d46fd => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:21.557119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 540/1093] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:21.558658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28105df-7993-46e6-aa6d-45a539b92bee None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.559748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.641155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.663834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a36a7-3181-4b74-950e-7fec65bc4e8e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.664520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28105df-7993-46e6-aa6d-45a539b92bee None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.697875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.698503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.698774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5900e7e-c229-4fd0-8276-eddcf7baeb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.698924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.699042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.699410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5900e7e-c229-4fd0-8276-eddcf7baeb1b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.699690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5900e7e-c229-4fd0-8276-eddcf7baeb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.699958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5900e7e-c229-4fd0-8276-eddcf7baeb1b None admin] PATH_INFO: `/v3/projects/921d90bd56364ad2902a9d72f83b63f8` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.701077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5900e7e-c229-4fd0-8276-eddcf7baeb1b None admin] RBAC: Authorizing `identity:get_project(project_id=921d90bd56364ad2902a9d72f83b63f8)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.702515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5900e7e-c229-4fd0-8276-eddcf7baeb1b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.704164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 554/1094] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/projects/921d90bd56364ad2902a9d72f83b63f8 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:21.705729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.707273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.710213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5900e7e-c229-4fd0-8276-eddcf7baeb1b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:07:21.718721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:21.719831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:21.721016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 541/1095] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:21.725837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.737604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.809472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5900e7e-c229-4fd0-8276-eddcf7baeb1b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.826364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71868011-6c00-4256-a6ed-217ade09709b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:21.841238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e233-2ffb-4379-8df6-225a03fcb13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.841916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e233-2ffb-4379-8df6-225a03fcb13f None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.842202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e233-2ffb-4379-8df6-225a03fcb13f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.842470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e233-2ffb-4379-8df6-225a03fcb13f None admin] PATH_INFO: `/v3/projects/921d90bd56364ad2902a9d72f83b63f8/users/7506893acc2a491884578681539d46fd/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.844348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e233-2ffb-4379-8df6-225a03fcb13f None admin] RBAC: Authorizing `identity:create_grant(project_id=921d90bd56364ad2902a9d72f83b63f8, user_id=7506893acc2a491884578681539d46fd, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.845793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e233-2ffb-4379-8df6-225a03fcb13f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.861308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71a4e-4e2d-40a3-a144-99957c074f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:21.861937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71a4e-4e2d-40a3-a144-99957c074f08 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:21.862247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71a4e-4e2d-40a3-a144-99957c074f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:21.862725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71a4e-4e2d-40a3-a144-99957c074f08 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:21.863646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71a4e-4e2d-40a3-a144-99957c074f08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:21.863959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71a4e-4e2d-40a3-a144-99957c074f08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:21.865471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71a4e-4e2d-40a3-a144-99957c074f08 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:21.868505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.869199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 555/1096] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:07:21 2022] PUT /identity/v3/projects/921d90bd56364ad2902a9d72f83b63f8/users/7506893acc2a491884578681539d46fd/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:07:21.879651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 542/1097] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:21.886096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e233-2ffb-4379-8df6-225a03fcb13f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:21.977117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:21.998212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e233-2ffb-4379-8df6-225a03fcb13f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:22.033605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d2f37-c376-4657-ac78-30d5b332da40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:22.034269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2f37-c376-4657-ac78-30d5b332da40 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:22.034548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2f37-c376-4657-ac78-30d5b332da40 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:22.034896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d2f37-c376-4657-ac78-30d5b332da40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:22.035625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d2f37-c376-4657-ac78-30d5b332da40 None admin] RBAC: Adding query filter params (role.id=69e45fcb7ca44ff3987645cbecb19ebb, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=7f5576a90945429a9127a2d4c53a729c) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:22.035931 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d2f37-c376-4657-ac78-30d5b332da40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:22.037381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d2f37-c376-4657-ac78-30d5b332da40 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:22.043479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 556/1098] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:21 2022] GET /identity/v3/role_assignments?user.id=7f5576a90945429a9127a2d4c53a729c&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=69e45fcb7ca44ff3987645cbecb19ebb => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:23.721272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bd399-ad3b-403d-897b-06801f5fa954 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:23.721821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bd399-ad3b-403d-897b-06801f5fa954 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:23.721821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bd399-ad3b-403d-897b-06801f5fa954 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:23.723194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 543/1099] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:23.728877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a52c6-f597-4e6e-b4f0-0b1d83e05e13 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:23.729365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a52c6-f597-4e6e-b4f0-0b1d83e05e13 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:23.729456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a52c6-f597-4e6e-b4f0-0b1d83e05e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:23.750703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-6d9a52c6-f597-4e6e-b4f0-0b1d83e05e13 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:23.751894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6d9a52c6-f597-4e6e-b4f0-0b1d83e05e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:23.833742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 557/1100] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:24.111925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bd399-ad3b-403d-897b-06801f5fa954 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:24.232652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bd399-ad3b-403d-897b-06801f5fa954 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:24.277160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edd5f2-c97b-479b-8dc4-e8dd7d1b5cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:24.277788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd5f2-c97b-479b-8dc4-e8dd7d1b5cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:24.278069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd5f2-c97b-479b-8dc4-e8dd7d1b5cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:24.278343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edd5f2-c97b-479b-8dc4-e8dd7d1b5cb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:24.288987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edd5f2-c97b-479b-8dc4-e8dd7d1b5cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-38edd5f2-c97b-479b-8dc4-e8dd7d1b5cb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:24.293789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:24.294888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:24.296050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:24.297358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 544/1101] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:24.302049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a52c6-f597-4e6e-b4f0-0b1d83e05e13 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:24.384873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:24.422635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a52c6-f597-4e6e-b4f0-0b1d83e05e13 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:24.466892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:24.467500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:24.467778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:24.468046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:24.468712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:24.469015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:24.470414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:24.479153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 558/1102] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:24.486491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edd5f2-c97b-479b-8dc4-e8dd7d1b5cb9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:24.553769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:24.599744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edd5f2-c97b-479b-8dc4-e8dd7d1b5cb9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:24.637368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d944f-b6b2-4b98-8be5-3f97ba2bd8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:24.637938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d944f-b6b2-4b98-8be5-3f97ba2bd8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:24.638215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d944f-b6b2-4b98-8be5-3f97ba2bd8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:24.638484 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d944f-b6b2-4b98-8be5-3f97ba2bd8b9 None admin] PATH_INFO: `/v3/users/7506893acc2a491884578681539d46fd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:24.639747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d944f-b6b2-4b98-8be5-3f97ba2bd8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=7506893acc2a491884578681539d46fd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:24.641548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d944f-b6b2-4b98-8be5-3f97ba2bd8b9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:24.643148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 545/1103] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:24 2022] GET /identity/v3/users/7506893acc2a491884578681539d46fd => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:24.649426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:24.756828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b8f4-3762-4277-9dcf-061f1a04b657 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:24.794431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3d29d-12eb-4967-b742-30e26dec8c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:24.795036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d29d-12eb-4967-b742-30e26dec8c0e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:24.795310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d29d-12eb-4967-b742-30e26dec8c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:24.795577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3d29d-12eb-4967-b742-30e26dec8c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:24.804380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:24.865486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3d29d-12eb-4967-b742-30e26dec8c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:24.866950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3d29d-12eb-4967-b742-30e26dec8c0e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:24.972891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 559/1104] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:24.979126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d944f-b6b2-4b98-8be5-3f97ba2bd8b9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:25.093058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d944f-b6b2-4b98-8be5-3f97ba2bd8b9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:25.116854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:25.128901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8e571-6104-4919-8d50-e960057b022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:25.129553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e571-6104-4919-8d50-e960057b022a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:25.129824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e571-6104-4919-8d50-e960057b022a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:25.130096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e571-6104-4919-8d50-e960057b022a None admin] PATH_INFO: `/v3/projects/921d90bd56364ad2902a9d72f83b63f8` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:25.131220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8e571-6104-4919-8d50-e960057b022a None admin] RBAC: Authorizing `identity:get_project(project_id=921d90bd56364ad2902a9d72f83b63f8)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:25.132649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8e571-6104-4919-8d50-e960057b022a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:25.134295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 546/1105] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:24 2022] GET /identity/v3/projects/921d90bd56364ad2902a9d72f83b63f8 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:25.141466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3d29d-12eb-4967-b742-30e26dec8c0e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:25.188853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:25.261745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3d29d-12eb-4967-b742-30e26dec8c0e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:25.300670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102f174-90b5-4914-8d43-a09130b9d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:25.301313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f174-90b5-4914-8d43-a09130b9d271 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:25.301591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f174-90b5-4914-8d43-a09130b9d271 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:25.301863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f174-90b5-4914-8d43-a09130b9d271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:25.302585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f174-90b5-4914-8d43-a09130b9d271 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=921d90bd56364ad2902a9d72f83b63f8, user.id=7506893acc2a491884578681539d46fd) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:25.302895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f174-90b5-4914-8d43-a09130b9d271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:25.304343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f174-90b5-4914-8d43-a09130b9d271 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:25.310102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 560/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:25 2022] GET /identity/v3/role_assignments?user.id=7506893acc2a491884578681539d46fd&scope.project.id=921d90bd56364ad2902a9d72f83b63f8&role.id=6da07502c09e4fc8afb31b58e434479b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:27.221747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a5be-24a3-4d95-b933-3261035647e6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:27.222335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a5be-24a3-4d95-b933-3261035647e6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:27.222452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4a5be-24a3-4d95-b933-3261035647e6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:27.223751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 547/1107] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:27.229273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca966b-4bfa-4953-9993-afb2aea59f4d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:27.229714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca966b-4bfa-4953-9993-afb2aea59f4d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:27.229808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca966b-4bfa-4953-9993-afb2aea59f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:27.250024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-43ca966b-4bfa-4953-9993-afb2aea59f4d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:27.251219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-43ca966b-4bfa-4953-9993-afb2aea59f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:27.322731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 561/1108] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:27.590506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4a5be-24a3-4d95-b933-3261035647e6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:27.710151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4a5be-24a3-4d95-b933-3261035647e6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:27.745286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a90f5-9e98-4098-b517-1971de3f0246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:27.745944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a90f5-9e98-4098-b517-1971de3f0246 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:27.746223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a90f5-9e98-4098-b517-1971de3f0246 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:27.746492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a90f5-9e98-4098-b517-1971de3f0246 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:27.747719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a90f5-9e98-4098-b517-1971de3f0246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:27.749177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a90f5-9e98-4098-b517-1971de3f0246 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:27.750737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 548/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:27.759799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca966b-4bfa-4953-9993-afb2aea59f4d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:27.792136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:27.866034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca966b-4bfa-4953-9993-afb2aea59f4d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:27.904652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df715883-1703-4cec-8866-4e79ceee4c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:27.905280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715883-1703-4cec-8866-4e79ceee4c33 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:27.905557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715883-1703-4cec-8866-4e79ceee4c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:27.905822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df715883-1703-4cec-8866-4e79ceee4c33 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:27.906466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df715883-1703-4cec-8866-4e79ceee4c33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:27.907885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df715883-1703-4cec-8866-4e79ceee4c33 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:27.930013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 562/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:07:27 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:07:29.846510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109ec1-5ea1-4199-9457-094c10d216d7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:29.847614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109ec1-5ea1-4199-9457-094c10d216d7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:29.847614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109ec1-5ea1-4199-9457-094c10d216d7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:29.849614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 549/1111] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:29.857591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ef8a-880d-44a6-880e-2df22fe739d0 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:29.858031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ef8a-880d-44a6-880e-2df22fe739d0 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:29.858124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32ef8a-880d-44a6-880e-2df22fe739d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:29.876807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8e32ef8a-880d-44a6-880e-2df22fe739d0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:29.878045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8e32ef8a-880d-44a6-880e-2df22fe739d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:29.946543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 563/1112] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:07:30.217219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45109ec1-5ea1-4199-9457-094c10d216d7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:30.303047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:30.358506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45109ec1-5ea1-4199-9457-094c10d216d7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:30.404474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f329b1-37e9-4108-9bd9-93d2f056cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:30.405120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f329b1-37e9-4108-9bd9-93d2f056cd64 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:30.405397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f329b1-37e9-4108-9bd9-93d2f056cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:30.405664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f329b1-37e9-4108-9bd9-93d2f056cd64 None admin] PATH_INFO: `/v3/roles/3fa1cdc33cf343228f9d443a59102f22` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:30.407155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f329b1-37e9-4108-9bd9-93d2f056cd64 None admin] RBAC: Authorizing `identity:get_role(role_id=3fa1cdc33cf343228f9d443a59102f22)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:30.408519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f329b1-37e9-4108-9bd9-93d2f056cd64 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:30.409918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 550/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:30 2022] GET /identity/v3/roles/3fa1cdc33cf343228f9d443a59102f22 => generated 223 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:30.418796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ef8a-880d-44a6-880e-2df22fe739d0 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:30.439515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:30.533949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32ef8a-880d-44a6-880e-2df22fe739d0 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:30.571680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4224e60-b10e-4fe3-aa91-d41888796398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:30.572304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4224e60-b10e-4fe3-aa91-d41888796398 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:30.572582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4224e60-b10e-4fe3-aa91-d41888796398 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:30.572854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4224e60-b10e-4fe3-aa91-d41888796398 None admin] PATH_INFO: `/v3/users/d5e331f21c354bb3896506757783396e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:30.587610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4224e60-b10e-4fe3-aa91-d41888796398 None admin] RBAC: Authorizing `identity:get_user(user_id=d5e331f21c354bb3896506757783396e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:30.589058 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4224e60-b10e-4fe3-aa91-d41888796398 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:30.590699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 564/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:30 2022] GET /identity/v3/users/d5e331f21c354bb3896506757783396e => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:30.597132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f329b1-37e9-4108-9bd9-93d2f056cd64 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:30.717165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f329b1-37e9-4108-9bd9-93d2f056cd64 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:30.748343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:30.758110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0e70-a61a-40bc-a4ab-b2659ca48c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:30.758712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0e70-a61a-40bc-a4ab-b2659ca48c64 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:30.758986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0e70-a61a-40bc-a4ab-b2659ca48c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:30.759249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0e70-a61a-40bc-a4ab-b2659ca48c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:30.830034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb0e70-a61a-40bc-a4ab-b2659ca48c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:30.831560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb0e70-a61a-40bc-a4ab-b2659ca48c64 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:30.934898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 551/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:30.941328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4224e60-b10e-4fe3-aa91-d41888796398 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:31.023159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:31.047975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4224e60-b10e-4fe3-aa91-d41888796398 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:31.086618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729ada-c54a-460a-b5fb-11b3b51e2612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:31.087190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729ada-c54a-460a-b5fb-11b3b51e2612 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:31.087467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729ada-c54a-460a-b5fb-11b3b51e2612 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:31.087735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729ada-c54a-460a-b5fb-11b3b51e2612 None admin] PATH_INFO: `/v3/projects/921d90bd56364ad2902a9d72f83b63f8` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:31.088990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729ada-c54a-460a-b5fb-11b3b51e2612 None admin] RBAC: Authorizing `identity:get_project(project_id=921d90bd56364ad2902a9d72f83b63f8)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:31.090475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729ada-c54a-460a-b5fb-11b3b51e2612 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:31.092107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 565/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:30 2022] GET /identity/v3/projects/921d90bd56364ad2902a9d72f83b63f8 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:31.098622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0e70-a61a-40bc-a4ab-b2659ca48c64 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:31.129282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:31.208420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0e70-a61a-40bc-a4ab-b2659ca48c64 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:31.246634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44b928-34f7-478f-a5c4-4cd4d60be2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:31.247237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44b928-34f7-478f-a5c4-4cd4d60be2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:31.247510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44b928-34f7-478f-a5c4-4cd4d60be2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:31.247779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44b928-34f7-478f-a5c4-4cd4d60be2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:31.248507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44b928-34f7-478f-a5c4-4cd4d60be2a3 None admin] RBAC: Adding query filter params (role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=921d90bd56364ad2902a9d72f83b63f8, user.id=d5e331f21c354bb3896506757783396e) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:31.248809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44b928-34f7-478f-a5c4-4cd4d60be2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:31.250274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44b928-34f7-478f-a5c4-4cd4d60be2a3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:31.257219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 552/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:31 2022] GET /identity/v3/role_assignments?user.id=d5e331f21c354bb3896506757783396e&scope.project.id=921d90bd56364ad2902a9d72f83b63f8&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:33.104727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b96e3-71a3-45c1-8188-8713c1764a0a None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:33.105441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b96e3-71a3-45c1-8188-8713c1764a0a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:33.105441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b96e3-71a3-45c1-8188-8713c1764a0a None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:33.107309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 566/1118] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:33.116226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063e44-e77d-4ced-8958-02e78b328f4b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:33.116649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063e44-e77d-4ced-8958-02e78b328f4b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:33.116779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063e44-e77d-4ced-8958-02e78b328f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:33.141418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4d063e44-e77d-4ced-8958-02e78b328f4b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:33.142610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4d063e44-e77d-4ced-8958-02e78b328f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:33.216958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 553/1119] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:33.478683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b96e3-71a3-45c1-8188-8713c1764a0a None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:33.597042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b96e3-71a3-45c1-8188-8713c1764a0a None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:33.634094 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2563b6-6e15-4b95-9f92-c83a8993e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:33.634724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2563b6-6e15-4b95-9f92-c83a8993e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:33.634997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2563b6-6e15-4b95-9f92-c83a8993e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:33.635261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2563b6-6e15-4b95-9f92-c83a8993e9f4 None admin] PATH_INFO: `/v3/roles/3fa1cdc33cf343228f9d443a59102f22` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:33.636783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2563b6-6e15-4b95-9f92-c83a8993e9f4 None admin] RBAC: Authorizing `identity:get_role(role_id=3fa1cdc33cf343228f9d443a59102f22)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:33.638174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2563b6-6e15-4b95-9f92-c83a8993e9f4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:33.639502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 567/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:33 2022] GET /identity/v3/roles/3fa1cdc33cf343228f9d443a59102f22 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:33.646041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d063e44-e77d-4ced-8958-02e78b328f4b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:33.670298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:33.758897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d063e44-e77d-4ced-8958-02e78b328f4b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:33.793966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e18bcf-bde9-493c-ab9d-cb785c4d7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:33.794588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e18bcf-bde9-493c-ab9d-cb785c4d7992 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:33.794861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e18bcf-bde9-493c-ab9d-cb785c4d7992 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:33.795131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e18bcf-bde9-493c-ab9d-cb785c4d7992 None admin] PATH_INFO: `/v3/users/d5e331f21c354bb3896506757783396e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:33.796247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e18bcf-bde9-493c-ab9d-cb785c4d7992 None admin] RBAC: Authorizing `identity:get_user(user_id=d5e331f21c354bb3896506757783396e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:33.797712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e18bcf-bde9-493c-ab9d-cb785c4d7992 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:33.799275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 554/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:33 2022] GET /identity/v3/users/d5e331f21c354bb3896506757783396e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:33.805509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2563b6-6e15-4b95-9f92-c83a8993e9f4 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:33.824151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:33.913740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2563b6-6e15-4b95-9f92-c83a8993e9f4 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:33.954969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea96b3-3d77-45fd-bbdd-8efee1909996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:33.955595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea96b3-3d77-45fd-bbdd-8efee1909996 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:33.955856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea96b3-3d77-45fd-bbdd-8efee1909996 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:33.956148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea96b3-3d77-45fd-bbdd-8efee1909996 None admin] PATH_INFO: `/v3/projects/921d90bd56364ad2902a9d72f83b63f8` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:33.957375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea96b3-3d77-45fd-bbdd-8efee1909996 None admin] RBAC: Authorizing `identity:get_project(project_id=921d90bd56364ad2902a9d72f83b63f8)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:33.958842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea96b3-3d77-45fd-bbdd-8efee1909996 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:33.960542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 568/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:33 2022] GET /identity/v3/projects/921d90bd56364ad2902a9d72f83b63f8 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:33.966790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e18bcf-bde9-493c-ab9d-cb785c4d7992 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:34.061834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:34.077192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e18bcf-bde9-493c-ab9d-cb785c4d7992 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:34.119945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fed80-3fda-48a8-b220-b56172029766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:34.120565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fed80-3fda-48a8-b220-b56172029766 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:34.120846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fed80-3fda-48a8-b220-b56172029766 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:34.121131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fed80-3fda-48a8-b220-b56172029766 None admin] PATH_INFO: `/v3/projects/921d90bd56364ad2902a9d72f83b63f8/users/d5e331f21c354bb3896506757783396e/roles/3fa1cdc33cf343228f9d443a59102f22` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:34.123628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fed80-3fda-48a8-b220-b56172029766 None admin] RBAC: Authorizing `identity:create_grant(project_id=921d90bd56364ad2902a9d72f83b63f8, user_id=d5e331f21c354bb3896506757783396e, role_id=3fa1cdc33cf343228f9d443a59102f22)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:34.125055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fed80-3fda-48a8-b220-b56172029766 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:34.139557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 555/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:07:33 2022] PUT /identity/v3/projects/921d90bd56364ad2902a9d72f83b63f8/users/d5e331f21c354bb3896506757783396e/roles/3fa1cdc33cf343228f9d443a59102f22 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:07:35.995316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc389d7-c5e3-4f20-a63e-6d0dfeb685a5 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:35.995890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc389d7-c5e3-4f20-a63e-6d0dfeb685a5 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:35.995890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc389d7-c5e3-4f20-a63e-6d0dfeb685a5 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:35.997118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 569/1124] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:36.003804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354d3e-0e96-4922-95ba-12d8f9026d4e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:36.004547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354d3e-0e96-4922-95ba-12d8f9026d4e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:36.004707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3354d3e-0e96-4922-95ba-12d8f9026d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:36.029249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a3354d3e-0e96-4922-95ba-12d8f9026d4e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:36.030448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a3354d3e-0e96-4922-95ba-12d8f9026d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:36.097809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 556/1125] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:36.362800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc389d7-c5e3-4f20-a63e-6d0dfeb685a5 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:36.458774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:36.480325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc389d7-c5e3-4f20-a63e-6d0dfeb685a5 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:36.514966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9dc5d-f3be-4c90-8fe6-2afba026dc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:36.515902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dc5d-f3be-4c90-8fe6-2afba026dc3d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:36.516179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dc5d-f3be-4c90-8fe6-2afba026dc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:36.516448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dc5d-f3be-4c90-8fe6-2afba026dc3d None admin] PATH_INFO: `/v3/roles/3fa1cdc33cf343228f9d443a59102f22` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:36.517929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9dc5d-f3be-4c90-8fe6-2afba026dc3d None admin] RBAC: Authorizing `identity:get_role(role_id=3fa1cdc33cf343228f9d443a59102f22)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:36.519360 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9dc5d-f3be-4c90-8fe6-2afba026dc3d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:36.520687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 570/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:36 2022] GET /identity/v3/roles/3fa1cdc33cf343228f9d443a59102f22 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:36.526985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3354d3e-0e96-4922-95ba-12d8f9026d4e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:36.612715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:36.636950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3354d3e-0e96-4922-95ba-12d8f9026d4e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:36.673932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13230a7-fe71-47b7-b8bb-e3179c2d014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:36.674555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13230a7-fe71-47b7-b8bb-e3179c2d014f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:36.675027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13230a7-fe71-47b7-b8bb-e3179c2d014f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:36.675299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13230a7-fe71-47b7-b8bb-e3179c2d014f None admin] PATH_INFO: `/v3/users/d5e331f21c354bb3896506757783396e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:36.676537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13230a7-fe71-47b7-b8bb-e3179c2d014f None admin] RBAC: Authorizing `identity:get_user(user_id=d5e331f21c354bb3896506757783396e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:36.678008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13230a7-fe71-47b7-b8bb-e3179c2d014f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:36.679582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 557/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:36 2022] GET /identity/v3/users/d5e331f21c354bb3896506757783396e => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:36.686314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9dc5d-f3be-4c90-8fe6-2afba026dc3d None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:36.803055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9dc5d-f3be-4c90-8fe6-2afba026dc3d None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:36.841188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8af326-1b2f-47be-8125-7941aec1a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:36.841789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8af326-1b2f-47be-8125-7941aec1a40f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:36.842067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8af326-1b2f-47be-8125-7941aec1a40f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:36.842335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8af326-1b2f-47be-8125-7941aec1a40f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:36.860619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:36.911314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8af326-1b2f-47be-8125-7941aec1a40f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:36.912691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8af326-1b2f-47be-8125-7941aec1a40f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:37.013539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 571/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:37.024065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13230a7-fe71-47b7-b8bb-e3179c2d014f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:37.129183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13230a7-fe71-47b7-b8bb-e3179c2d014f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:37.164306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f01067-fd6c-41f3-a465-6bb2096004a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:37.164853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01067-fd6c-41f3-a465-6bb2096004a9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:37.165129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01067-fd6c-41f3-a465-6bb2096004a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:37.165428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f01067-fd6c-41f3-a465-6bb2096004a9 None admin] PATH_INFO: `/v3/projects/921d90bd56364ad2902a9d72f83b63f8` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:37.166531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f01067-fd6c-41f3-a465-6bb2096004a9 None admin] RBAC: Authorizing `identity:get_project(project_id=921d90bd56364ad2902a9d72f83b63f8)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:37.167952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f01067-fd6c-41f3-a465-6bb2096004a9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:37.169600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 558/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:37 2022] GET /identity/v3/projects/921d90bd56364ad2902a9d72f83b63f8 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:37.175896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8af326-1b2f-47be-8125-7941aec1a40f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:37.234547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:37.301321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8af326-1b2f-47be-8125-7941aec1a40f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:37.335979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf255bec-6977-48c2-bf75-ef434a52a0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:37.336568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255bec-6977-48c2-bf75-ef434a52a0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:37.336839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255bec-6977-48c2-bf75-ef434a52a0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:37.337129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf255bec-6977-48c2-bf75-ef434a52a0e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:37.337842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf255bec-6977-48c2-bf75-ef434a52a0e2 None admin] RBAC: Adding query filter params (role.id=3fa1cdc33cf343228f9d443a59102f22, scope.project.id=921d90bd56364ad2902a9d72f83b63f8, user.id=d5e331f21c354bb3896506757783396e) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:37.338143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf255bec-6977-48c2-bf75-ef434a52a0e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:37.339551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf255bec-6977-48c2-bf75-ef434a52a0e2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:37.345327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 572/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:37 2022] GET /identity/v3/role_assignments?user.id=d5e331f21c354bb3896506757783396e&scope.project.id=921d90bd56364ad2902a9d72f83b63f8&role.id=3fa1cdc33cf343228f9d443a59102f22 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:39.285751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853fb4-b7b3-4f10-acef-c6c8d74390e5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:39.286645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853fb4-b7b3-4f10-acef-c6c8d74390e5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:39.286645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a853fb4-b7b3-4f10-acef-c6c8d74390e5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:39.288712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 559/1131] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:39.295160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bba159-819a-45de-a473-cc4228a62ddb None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:39.295871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bba159-819a-45de-a473-cc4228a62ddb None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:39.296046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bba159-819a-45de-a473-cc4228a62ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:39.322501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b3bba159-819a-45de-a473-cc4228a62ddb None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:39.323709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b3bba159-819a-45de-a473-cc4228a62ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:39.398395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 573/1132] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:39.672666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853fb4-b7b3-4f10-acef-c6c8d74390e5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:39.694812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:39.788867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a853fb4-b7b3-4f10-acef-c6c8d74390e5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:39.824230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625929e-17b2-4939-9789-ee9aa4502574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:39.824848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625929e-17b2-4939-9789-ee9aa4502574 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:39.825129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625929e-17b2-4939-9789-ee9aa4502574 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:39.825751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625929e-17b2-4939-9789-ee9aa4502574 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:39.826549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625929e-17b2-4939-9789-ee9aa4502574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:39.828330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625929e-17b2-4939-9789-ee9aa4502574 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:39.829569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 560/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:39.839554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bba159-819a-45de-a473-cc4228a62ddb None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:39.887014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:39.947592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bba159-819a-45de-a473-cc4228a62ddb None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:39.983859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b61e8-9c47-4ffd-97ed-521d272deab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:39.984457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b61e8-9c47-4ffd-97ed-521d272deab5 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:39.984732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b61e8-9c47-4ffd-97ed-521d272deab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:39.984962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b61e8-9c47-4ffd-97ed-521d272deab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:39.985653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b61e8-9c47-4ffd-97ed-521d272deab5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:39.987103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b61e8-9c47-4ffd-97ed-521d272deab5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:40.020296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 574/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:07:39 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:41.923962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d861c-9a78-49ca-8e97-8437fa2cd4a4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:41.924489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d861c-9a78-49ca-8e97-8437fa2cd4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:41.924489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d861c-9a78-49ca-8e97-8437fa2cd4a4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:41.925855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 561/1135] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:41.932138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33352-bb21-483a-b6c5-f871f6d38cde None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:41.932876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33352-bb21-483a-b6c5-f871f6d38cde None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:41.933020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33352-bb21-483a-b6c5-f871f6d38cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:41.961235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-bbf33352-bb21-483a-b6c5-f871f6d38cde None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:41.962433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-bbf33352-bb21-483a-b6c5-f871f6d38cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:42.049100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 575/1136] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:42.313565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d861c-9a78-49ca-8e97-8437fa2cd4a4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:42.405114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:42.425068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d861c-9a78-49ca-8e97-8437fa2cd4a4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:42.460141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8bde-42c6-4c7a-93e5-eee52ed5b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:42.460769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8bde-42c6-4c7a-93e5-eee52ed5b88a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:42.461044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8bde-42c6-4c7a-93e5-eee52ed5b88a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:42.461341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8bde-42c6-4c7a-93e5-eee52ed5b88a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:42.462566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8bde-42c6-4c7a-93e5-eee52ed5b88a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:42.463994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8bde-42c6-4c7a-93e5-eee52ed5b88a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:42.465608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 562/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:07:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:42.471784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33352-bb21-483a-b6c5-f871f6d38cde None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:42.500608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:42.584195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33352-bb21-483a-b6c5-f871f6d38cde None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:42.619697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfce5fe-6236-4c54-b5fd-d5188db40edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:42.620305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfce5fe-6236-4c54-b5fd-d5188db40edb None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:42.620579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfce5fe-6236-4c54-b5fd-d5188db40edb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:42.620847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfce5fe-6236-4c54-b5fd-d5188db40edb None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:42.621520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfce5fe-6236-4c54-b5fd-d5188db40edb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:42.623025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfce5fe-6236-4c54-b5fd-d5188db40edb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:42.648344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 576/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:07:42 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:44.555309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728955a1-f956-4f82-a59d-d8f0e7654c38 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:44.555895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728955a1-f956-4f82-a59d-d8f0e7654c38 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:44.555895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728955a1-f956-4f82-a59d-d8f0e7654c38 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:44.557241 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 563/1139] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:44.563409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d018-1a4f-400c-ad9e-119f5ef479a1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:44.564177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d018-1a4f-400c-ad9e-119f5ef479a1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:44.564297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1d018-1a4f-400c-ad9e-119f5ef479a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:44.586957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4bb1d018-1a4f-400c-ad9e-119f5ef479a1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:44.588148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4bb1d018-1a4f-400c-ad9e-119f5ef479a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:44.665681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 577/1140] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:44.927813 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728955a1-f956-4f82-a59d-d8f0e7654c38 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:45.037692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728955a1-f956-4f82-a59d-d8f0e7654c38 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:45.073341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339f49-89c8-4554-b776-6ad547de8702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:45.073952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339f49-89c8-4554-b776-6ad547de8702 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:45.074230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339f49-89c8-4554-b776-6ad547de8702 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:45.074497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339f49-89c8-4554-b776-6ad547de8702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:45.085534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339f49-89c8-4554-b776-6ad547de8702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-15339f49-89c8-4554-b776-6ad547de8702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:45.090371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:45.091533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:45.092496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 564/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:07:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:45.099111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1d018-1a4f-400c-ad9e-119f5ef479a1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:45.110790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:45.204069 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1d018-1a4f-400c-ad9e-119f5ef479a1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:45.237759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:45.238371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:45.238644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:45.238914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:45.239584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:45.239885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:45.241287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:45.249350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 578/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:07:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:07:45.255658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339f49-89c8-4554-b776-6ad547de8702 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:45.272924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:45.367659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339f49-89c8-4554-b776-6ad547de8702 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:45.403199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc270-e715-4c00-893b-2fc55f727ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:45.403815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc270-e715-4c00-893b-2fc55f727ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:45.404088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc270-e715-4c00-893b-2fc55f727ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:45.404351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bc270-e715-4c00-893b-2fc55f727ad8 None admin] PATH_INFO: `/v3/users/0f92bab6d66d48b0a5b8e50250abcaee` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:45.419259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc270-e715-4c00-893b-2fc55f727ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=0f92bab6d66d48b0a5b8e50250abcaee)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:45.420677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bc270-e715-4c00-893b-2fc55f727ad8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:45.422448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 565/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:45 2022] GET /identity/v3/users/0f92bab6d66d48b0a5b8e50250abcaee => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:45.428811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:45.505312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:45.539748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15246d51-aa97-4d53-ada8-234b86a5bc58 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:45.575000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73242219-6fda-46b7-9359-9abf4f640111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:45.575616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73242219-6fda-46b7-9359-9abf4f640111 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:45.575851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73242219-6fda-46b7-9359-9abf4f640111 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:45.576118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73242219-6fda-46b7-9359-9abf4f640111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:45.653379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73242219-6fda-46b7-9359-9abf4f640111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:45.654827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73242219-6fda-46b7-9359-9abf4f640111 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:45.721598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:45.752483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 579/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:45.758673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc270-e715-4c00-893b-2fc55f727ad8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:45.833809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:45.869561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bc270-e715-4c00-893b-2fc55f727ad8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:45.906026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648d25f-0874-4da9-b082-12b04ba9c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:45.906647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648d25f-0874-4da9-b082-12b04ba9c185 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:45.906922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648d25f-0874-4da9-b082-12b04ba9c185 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:45.907190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648d25f-0874-4da9-b082-12b04ba9c185 None admin] PATH_INFO: `/v3/projects/b4cd16792de24f3fbc5fcb1da58f792f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:45.908357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648d25f-0874-4da9-b082-12b04ba9c185 None admin] RBAC: Authorizing `identity:get_project(project_id=b4cd16792de24f3fbc5fcb1da58f792f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:45.909821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648d25f-0874-4da9-b082-12b04ba9c185 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:45.911690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 566/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:45 2022] GET /identity/v3/projects/b4cd16792de24f3fbc5fcb1da58f792f => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:45.918141 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73242219-6fda-46b7-9359-9abf4f640111 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:46.023202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73242219-6fda-46b7-9359-9abf4f640111 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:46.059873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16f973-b7e3-487c-bbe0-9b9365c26383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:46.060457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16f973-b7e3-487c-bbe0-9b9365c26383 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:46.060733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16f973-b7e3-487c-bbe0-9b9365c26383 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:46.061001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16f973-b7e3-487c-bbe0-9b9365c26383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:46.061756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16f973-b7e3-487c-bbe0-9b9365c26383 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=b4cd16792de24f3fbc5fcb1da58f792f, user.id=0f92bab6d66d48b0a5b8e50250abcaee) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:46.062065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16f973-b7e3-487c-bbe0-9b9365c26383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:46.063465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c16f973-b7e3-487c-bbe0-9b9365c26383 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:46.069294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 580/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:45 2022] GET /identity/v3/role_assignments?user.id=0f92bab6d66d48b0a5b8e50250abcaee&scope.project.id=b4cd16792de24f3fbc5fcb1da58f792f&role.id=6da07502c09e4fc8afb31b58e434479b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:47.963041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950a75a-7e52-4287-8f4e-f6e2b799d84b None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:47.963586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950a75a-7e52-4287-8f4e-f6e2b799d84b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:47.963586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950a75a-7e52-4287-8f4e-f6e2b799d84b None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:47.964823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 567/1147] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:47.971025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e571-bae6-41a0-b9b8-ea72f18cc586 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:47.971715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e571-bae6-41a0-b9b8-ea72f18cc586 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:47.971910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e571-bae6-41a0-b9b8-ea72f18cc586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:47.997073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-e4a6e571-bae6-41a0-b9b8-ea72f18cc586 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:47.998303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e4a6e571-bae6-41a0-b9b8-ea72f18cc586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:48.030068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:48.070231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 581/1148] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:48.347228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950a75a-7e52-4287-8f4e-f6e2b799d84b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:48.472827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950a75a-7e52-4287-8f4e-f6e2b799d84b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:48.508701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21230be-b3c9-41f6-a782-624b845328dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:48.509350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21230be-b3c9-41f6-a782-624b845328dc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:48.509632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21230be-b3c9-41f6-a782-624b845328dc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:48.509900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21230be-b3c9-41f6-a782-624b845328dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:48.518397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:48.522826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21230be-b3c9-41f6-a782-624b845328dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e21230be-b3c9-41f6-a782-624b845328dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:48.528043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:48.529172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:48.530410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 568/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:48.539368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e571-bae6-41a0-b9b8-ea72f18cc586 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:48.660180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e571-bae6-41a0-b9b8-ea72f18cc586 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:48.695997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:48.696593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:48.696860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:48.697133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:48.697807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:48.698100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:48.699448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:48.708107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 582/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:48.714212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21230be-b3c9-41f6-a782-624b845328dc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:48.823479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21230be-b3c9-41f6-a782-624b845328dc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:48.859006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3057f4-678d-4601-8bcc-791e1d7f0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:48.859622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3057f4-678d-4601-8bcc-791e1d7f0595 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:48.859896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3057f4-678d-4601-8bcc-791e1d7f0595 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:48.860168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3057f4-678d-4601-8bcc-791e1d7f0595 None admin] PATH_INFO: `/v3/users/0f92bab6d66d48b0a5b8e50250abcaee` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:48.861442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3057f4-678d-4601-8bcc-791e1d7f0595 None admin] RBAC: Authorizing `identity:get_user(user_id=0f92bab6d66d48b0a5b8e50250abcaee)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:48.862868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3057f4-678d-4601-8bcc-791e1d7f0595 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:48.864732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 569/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:48 2022] GET /identity/v3/users/0f92bab6d66d48b0a5b8e50250abcaee => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:48.871346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:48.903427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:48.980933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20feb-1b75-4cf2-bc21-568e1a05258a None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:49.016669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38807ec-d530-446a-ad64-761cec748f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:49.017317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38807ec-d530-446a-ad64-761cec748f8a None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:49.017594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38807ec-d530-446a-ad64-761cec748f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:49.017864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38807ec-d530-446a-ad64-761cec748f8a None admin] PATH_INFO: `/v3/projects/b4cd16792de24f3fbc5fcb1da58f792f` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:49.019103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38807ec-d530-446a-ad64-761cec748f8a None admin] RBAC: Authorizing `identity:get_project(project_id=b4cd16792de24f3fbc5fcb1da58f792f)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:49.020590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38807ec-d530-446a-ad64-761cec748f8a None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:49.022290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 583/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:48 2022] GET /identity/v3/projects/b4cd16792de24f3fbc5fcb1da58f792f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:49.028770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3057f4-678d-4601-8bcc-791e1d7f0595 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:49.096443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:49.132052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3057f4-678d-4601-8bcc-791e1d7f0595 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:49.167752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504617ff-9684-4b4b-b65e-2901e6d600ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:49.168335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504617ff-9684-4b4b-b65e-2901e6d600ca None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:49.168616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504617ff-9684-4b4b-b65e-2901e6d600ca None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:49.168887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504617ff-9684-4b4b-b65e-2901e6d600ca None admin] PATH_INFO: `/v3/projects/b4cd16792de24f3fbc5fcb1da58f792f/users/0f92bab6d66d48b0a5b8e50250abcaee/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:49.171089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504617ff-9684-4b4b-b65e-2901e6d600ca None admin] RBAC: Authorizing `identity:create_grant(project_id=b4cd16792de24f3fbc5fcb1da58f792f, user_id=0f92bab6d66d48b0a5b8e50250abcaee, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:49.172538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504617ff-9684-4b4b-b65e-2901e6d600ca None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:49.187309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 570/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:07:49 2022] PUT /identity/v3/projects/b4cd16792de24f3fbc5fcb1da58f792f/users/0f92bab6d66d48b0a5b8e50250abcaee/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:07:51.050265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08042dc-2ce9-4943-9286-c961dc6f82ab None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:51.051167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08042dc-2ce9-4943-9286-c961dc6f82ab None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:51.051312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08042dc-2ce9-4943-9286-c961dc6f82ab None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:51.053553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 584/1154] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:51.058913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7395-8bcf-402f-ba74-778d6f70c5e7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:51.059334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7395-8bcf-402f-ba74-778d6f70c5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:51.059441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a7395-8bcf-402f-ba74-778d6f70c5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:51.079840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-db1a7395-8bcf-402f-ba74-778d6f70c5e7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:51.081031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-db1a7395-8bcf-402f-ba74-778d6f70c5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:51.151493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 571/1155] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:51.414859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08042dc-2ce9-4943-9286-c961dc6f82ab None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:51.516606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:51.524297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08042dc-2ce9-4943-9286-c961dc6f82ab None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:51.568892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da95e-20e4-459e-8d6c-c15ab937fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:51.569541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da95e-20e4-459e-8d6c-c15ab937fedb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:51.569814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da95e-20e4-459e-8d6c-c15ab937fedb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:51.570078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da95e-20e4-459e-8d6c-c15ab937fedb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:51.580415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018da95e-20e4-459e-8d6c-c15ab937fedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-018da95e-20e4-459e-8d6c-c15ab937fedb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:07:51.585475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:51.586544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:07:51.587875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 585/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:51.596164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a7395-8bcf-402f-ba74-778d6f70c5e7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:51.663063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:51.717854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a7395-8bcf-402f-ba74-778d6f70c5e7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:51.753213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:51.753848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:51.754270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:51.754544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:51.755214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:51.755519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:51.756894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:51.765073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 572/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:51.772327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da95e-20e4-459e-8d6c-c15ab937fedb None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:51.875604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da95e-20e4-459e-8d6c-c15ab937fedb None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:51.914178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f822d-4cee-49b2-94f0-0f13a3772b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:51.914792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f822d-4cee-49b2-94f0-0f13a3772b28 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:51.915068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f822d-4cee-49b2-94f0-0f13a3772b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:51.915341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f822d-4cee-49b2-94f0-0f13a3772b28 None admin] PATH_INFO: `/v3/users/0f92bab6d66d48b0a5b8e50250abcaee` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:51.916590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f822d-4cee-49b2-94f0-0f13a3772b28 None admin] RBAC: Authorizing `identity:get_user(user_id=0f92bab6d66d48b0a5b8e50250abcaee)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:51.918032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f822d-4cee-49b2-94f0-0f13a3772b28 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:51.919613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 586/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:07:51 2022] GET /identity/v3/users/0f92bab6d66d48b0a5b8e50250abcaee => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:51.925776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:52.031058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17280b-aa4d-43fc-9a09-15f3aeef71cb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:52.047948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:52.066742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eb476-a1b3-483c-90ed-3353eb6cf184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:52.067351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb476-a1b3-483c-90ed-3353eb6cf184 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:52.067613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb476-a1b3-483c-90ed-3353eb6cf184 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:52.067885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eb476-a1b3-483c-90ed-3353eb6cf184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:52.136449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4eb476-a1b3-483c-90ed-3353eb6cf184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:52.137922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4eb476-a1b3-483c-90ed-3353eb6cf184 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:52.239176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 573/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 05:07:52.245939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f822d-4cee-49b2-94f0-0f13a3772b28 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:52.272747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:52.353793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f822d-4cee-49b2-94f0-0f13a3772b28 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:52.389989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403cd39-8e1e-4c82-bb34-72d32486bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:52.390959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403cd39-8e1e-4c82-bb34-72d32486bf6b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:52.391237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403cd39-8e1e-4c82-bb34-72d32486bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:52.391508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403cd39-8e1e-4c82-bb34-72d32486bf6b None admin] PATH_INFO: `/v3/projects/b4cd16792de24f3fbc5fcb1da58f792f` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:52.392752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403cd39-8e1e-4c82-bb34-72d32486bf6b None admin] RBAC: Authorizing `identity:get_project(project_id=b4cd16792de24f3fbc5fcb1da58f792f)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:52.394223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403cd39-8e1e-4c82-bb34-72d32486bf6b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:52.395922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 587/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:07:52 2022] GET /identity/v3/projects/b4cd16792de24f3fbc5fcb1da58f792f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:52.402322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eb476-a1b3-483c-90ed-3353eb6cf184 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:52.421112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:52.504904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eb476-a1b3-483c-90ed-3353eb6cf184 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:52.541056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da0a0e-bd81-4c86-ae9a-78eb968b1328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:52.541712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0a0e-bd81-4c86-ae9a-78eb968b1328 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:52.541989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0a0e-bd81-4c86-ae9a-78eb968b1328 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:52.542259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0a0e-bd81-4c86-ae9a-78eb968b1328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:52.542982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da0a0e-bd81-4c86-ae9a-78eb968b1328 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=b4cd16792de24f3fbc5fcb1da58f792f, user.id=0f92bab6d66d48b0a5b8e50250abcaee) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:52.543294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da0a0e-bd81-4c86-ae9a-78eb968b1328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:52.544727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da0a0e-bd81-4c86-ae9a-78eb968b1328 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:52.551328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 574/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:07:52 2022] GET /identity/v3/role_assignments?user.id=0f92bab6d66d48b0a5b8e50250abcaee&scope.project.id=b4cd16792de24f3fbc5fcb1da58f792f&role.id=6da07502c09e4fc8afb31b58e434479b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:54.452795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf45b-2efb-40f7-9670-f4e66a151a05 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:54.453395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf45b-2efb-40f7-9670-f4e66a151a05 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:54.453395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23bf45b-2efb-40f7-9670-f4e66a151a05 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:54.454695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 588/1162] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:54.461295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7e03-ca4a-4ca7-b038-1d70327851f4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:54.461983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7e03-ca4a-4ca7-b038-1d70327851f4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:54.462162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7e03-ca4a-4ca7-b038-1d70327851f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:54.484182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f7cf7e03-ca4a-4ca7-b038-1d70327851f4 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:54.485425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f7cf7e03-ca4a-4ca7-b038-1d70327851f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:54.557648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 575/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:54.838372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bf45b-2efb-40f7-9670-f4e66a151a05 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:54.938379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:54.950007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23bf45b-2efb-40f7-9670-f4e66a151a05 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:54.984735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb118-5b3d-49b6-8ac9-99c945717fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:54.985352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb118-5b3d-49b6-8ac9-99c945717fdf None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:54.985627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb118-5b3d-49b6-8ac9-99c945717fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:54.985855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb118-5b3d-49b6-8ac9-99c945717fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:55.057038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb118-5b3d-49b6-8ac9-99c945717fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:55.058491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb118-5b3d-49b6-8ac9-99c945717fdf None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:55.176538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:55.194181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 589/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:07:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:07:55.203640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7e03-ca4a-4ca7-b038-1d70327851f4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:55.220102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:55.317733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7e03-ca4a-4ca7-b038-1d70327851f4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:55.353912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98270-48e0-4a78-8055-1a27bd908ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:55.354540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98270-48e0-4a78-8055-1a27bd908ecc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:55.354820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98270-48e0-4a78-8055-1a27bd908ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:55.355087 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98270-48e0-4a78-8055-1a27bd908ecc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:55.361934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b98270-48e0-4a78-8055-1a27bd908ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:55.363417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b98270-48e0-4a78-8055-1a27bd908ecc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-25b98270-48e0-4a78-8055-1a27bd908ecc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:07:55.375313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:07:55.376492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:07:55.377585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 576/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:07:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:07:55.382992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb118-5b3d-49b6-8ac9-99c945717fdf None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:55.502446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb118-5b3d-49b6-8ac9-99c945717fdf None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:55.539515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c3700-134a-4d1e-9b52-26db9c65bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:55.540112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3700-134a-4d1e-9b52-26db9c65bd61 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:55.540389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3700-134a-4d1e-9b52-26db9c65bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:55.540661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3700-134a-4d1e-9b52-26db9c65bd61 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:55.541309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c3700-134a-4d1e-9b52-26db9c65bd61 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:07:55.541608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c3700-134a-4d1e-9b52-26db9c65bd61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:55.542969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c3700-134a-4d1e-9b52-26db9c65bd61 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:55.550095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 590/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Aug 31 05:07:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:07:57.467883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e34-79d9-4c11-8eac-2c676051f217 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:57.468725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e34-79d9-4c11-8eac-2c676051f217 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:57.468725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e34-79d9-4c11-8eac-2c676051f217 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:57.470963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 577/1167] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:57.477000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e1d85-f741-4b2a-b4ca-867eb493ea6f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:57.477478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e1d85-f741-4b2a-b4ca-867eb493ea6f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:57.477579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e1d85-f741-4b2a-b4ca-867eb493ea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:57.497654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7c3e1d85-f741-4b2a-b4ca-867eb493ea6f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:57.498829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7c3e1d85-f741-4b2a-b4ca-867eb493ea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:07:57.554579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:57.572350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 591/1168] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:07:57.842586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81e34-79d9-4c11-8eac-2c676051f217 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:07:57.925435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:07:57.960587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81e34-79d9-4c11-8eac-2c676051f217 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:07:57.997048 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221536bf-0796-41cf-ab9d-63d6155c7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:07:57.997706 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221536bf-0796-41cf-ab9d-63d6155c7bec None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:57.997984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221536bf-0796-41cf-ab9d-63d6155c7bec None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:57.998252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221536bf-0796-41cf-ab9d-63d6155c7bec None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:57.998905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221536bf-0796-41cf-ab9d-63d6155c7bec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:07:58.000274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221536bf-0796-41cf-ab9d-63d6155c7bec None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:07:58.018734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 578/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Aug 31 05:07:57 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:07:59.925910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f9e6-e3f0-49b6-a7de-a47026c32ff3 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:59.926592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f9e6-e3f0-49b6-a7de-a47026c32ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:59.926592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f9e6-e3f0-49b6-a7de-a47026c32ff3 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:59.927742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 592/1170] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:07:59.934088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0a6fa-387d-4aa7-9734-755466742d6f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:07:59.934804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0a6fa-387d-4aa7-9734-755466742d6f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:07:59.934958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0a6fa-387d-4aa7-9734-755466742d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:07:59.962853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d9d0a6fa-387d-4aa7-9734-755466742d6f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:07:59.964033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d9d0a6fa-387d-4aa7-9734-755466742d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:08:00.040863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 579/1171] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:07:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:08:00.304203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99f9e6-e3f0-49b6-a7de-a47026c32ff3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:00.420220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99f9e6-e3f0-49b6-a7de-a47026c32ff3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:00.459915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e55c5-0d84-4e6f-9197-3462a29b3f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:00.460538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e55c5-0d84-4e6f-9197-3462a29b3f84 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:00.460812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e55c5-0d84-4e6f-9197-3462a29b3f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:00.461120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e55c5-0d84-4e6f-9197-3462a29b3f84 None admin] PATH_INFO: `/v3/domains/5e9554ad13504252923856c66c10c014` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:00.471634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e55c5-0d84-4e6f-9197-3462a29b3f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5e9554ad13504252923856c66c10c014)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:00.473115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e55c5-0d84-4e6f-9197-3462a29b3f84 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:00.474726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 593/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Aug 31 05:08:00 2022] GET /identity/v3/domains/5e9554ad13504252923856c66c10c014 => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:00.481414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0a6fa-387d-4aa7-9734-755466742d6f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:00.548708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:00.602717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0a6fa-387d-4aa7-9734-755466742d6f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:00.641537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55828996-0310-4385-a097-29f5ec532c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:00.642163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828996-0310-4385-a097-29f5ec532c89 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:00.642441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828996-0310-4385-a097-29f5ec532c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:00.642713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55828996-0310-4385-a097-29f5ec532c89 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:00.643364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55828996-0310-4385-a097-29f5ec532c89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:00.644855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55828996-0310-4385-a097-29f5ec532c89 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:00.673991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 580/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:08:00 2022] POST /identity/v3/projects => generated 361 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:08:02.585233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70143d-ee7d-4d19-acb6-997ecb618645 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:02.585902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70143d-ee7d-4d19-acb6-997ecb618645 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:02.585902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70143d-ee7d-4d19-acb6-997ecb618645 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:02.587162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 594/1174] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:08:02.593771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b29da-7be3-44b3-b954-b14cfbb1962c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:02.594528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b29da-7be3-44b3-b954-b14cfbb1962c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:02.594673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b29da-7be3-44b3-b954-b14cfbb1962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:02.616071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b06b29da-7be3-44b3-b954-b14cfbb1962c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:08:02.617329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b06b29da-7be3-44b3-b954-b14cfbb1962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:08:02.689426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 581/1175] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:08:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:08:02.963604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70143d-ee7d-4d19-acb6-997ecb618645 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:03.018365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:03.076944 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70143d-ee7d-4d19-acb6-997ecb618645 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:03.113241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1668747-9f24-4d48-82b7-ec1b5c7cd18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:03.113748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668747-9f24-4d48-82b7-ec1b5c7cd18f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:03.114019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668747-9f24-4d48-82b7-ec1b5c7cd18f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:03.114285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1668747-9f24-4d48-82b7-ec1b5c7cd18f None admin] PATH_INFO: `/v3/domains/5e9554ad13504252923856c66c10c014` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:03.115504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1668747-9f24-4d48-82b7-ec1b5c7cd18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=5e9554ad13504252923856c66c10c014)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:03.116926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1668747-9f24-4d48-82b7-ec1b5c7cd18f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:03.118521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 595/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Aug 31 05:08:02 2022] GET /identity/v3/domains/5e9554ad13504252923856c66c10c014 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:03.125038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b29da-7be3-44b3-b954-b14cfbb1962c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:03.175677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:03.230984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b29da-7be3-44b3-b954-b14cfbb1962c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:03.268575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6511eb-a82b-4df4-8051-eccf0c350f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:03.269226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6511eb-a82b-4df4-8051-eccf0c350f39 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:03.269712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6511eb-a82b-4df4-8051-eccf0c350f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:03.269991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6511eb-a82b-4df4-8051-eccf0c350f39 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:03.270648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6511eb-a82b-4df4-8051-eccf0c350f39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:03.272096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6511eb-a82b-4df4-8051-eccf0c350f39 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:03.295723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 582/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:08:03 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:08:05.200320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3588c9-199d-447a-a95d-4b5d9e1e1f25 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:05.200900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3588c9-199d-447a-a95d-4b5d9e1e1f25 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:05.200900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3588c9-199d-447a-a95d-4b5d9e1e1f25 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:05.202235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 596/1178] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:08:05.207672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15b73-8aaf-4939-a4ab-44cf07d165af None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:05.208102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15b73-8aaf-4939-a4ab-44cf07d165af None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:05.208203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c15b73-8aaf-4939-a4ab-44cf07d165af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:05.229131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-71c15b73-8aaf-4939-a4ab-44cf07d165af None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:08:05.230326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-71c15b73-8aaf-4939-a4ab-44cf07d165af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:08:05.303965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 583/1179] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:08:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:08:05.568393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3588c9-199d-447a-a95d-4b5d9e1e1f25 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:05.693116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3588c9-199d-447a-a95d-4b5d9e1e1f25 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:05.707339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:05.728378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152368df-ac65-4577-8318-12db8ad49c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:05.729001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152368df-ac65-4577-8318-12db8ad49c88 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:05.729311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152368df-ac65-4577-8318-12db8ad49c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:05.729580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152368df-ac65-4577-8318-12db8ad49c88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:05.739880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152368df-ac65-4577-8318-12db8ad49c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-152368df-ac65-4577-8318-12db8ad49c88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:08:05.744643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:08:05.745969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:08:05.746921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 597/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:08:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:08:05.751940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15b73-8aaf-4939-a4ab-44cf07d165af None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:05.782162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:05.852188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c15b73-8aaf-4939-a4ab-44cf07d165af None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:05.887652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:05.888254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:05.888527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:05.888791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:05.889488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:08:05.889792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:05.891465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:05.899843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 584/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:08:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:05.906022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152368df-ac65-4577-8318-12db8ad49c88 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:06.012589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152368df-ac65-4577-8318-12db8ad49c88 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:06.048258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cf0a4-0ab4-4fbf-b523-0262be0f8021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:06.048871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cf0a4-0ab4-4fbf-b523-0262be0f8021 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:06.049179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cf0a4-0ab4-4fbf-b523-0262be0f8021 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:06.049452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cf0a4-0ab4-4fbf-b523-0262be0f8021 None admin] PATH_INFO: `/v3/users/537769630592457791ee996f9368a724` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:06.062921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cf0a4-0ab4-4fbf-b523-0262be0f8021 None admin] RBAC: Authorizing `identity:get_user(user_id=537769630592457791ee996f9368a724)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:06.064352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cf0a4-0ab4-4fbf-b523-0262be0f8021 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:06.065981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 598/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:08:05 2022] GET /identity/v3/users/537769630592457791ee996f9368a724 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:06.072514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:06.183214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:06.193127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cd942-a1f1-4ed0-b46e-68fa5da6b9a5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:06.228963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392e8c-876d-453c-aad2-fd9014da86c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:06.229612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392e8c-876d-453c-aad2-fd9014da86c5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:06.229854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392e8c-876d-453c-aad2-fd9014da86c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:06.230116 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392e8c-876d-453c-aad2-fd9014da86c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:06.299282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a392e8c-876d-453c-aad2-fd9014da86c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:06.300716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a392e8c-876d-453c-aad2-fd9014da86c5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:06.403499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:06.416895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 585/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:08:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:08:06.423274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cf0a4-0ab4-4fbf-b523-0262be0f8021 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:06.457471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:06.537610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cf0a4-0ab4-4fbf-b523-0262be0f8021 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:06.573825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a059168-554f-4ea7-a2c6-fa65365fa60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:06.574448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a059168-554f-4ea7-a2c6-fa65365fa60d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:06.574729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a059168-554f-4ea7-a2c6-fa65365fa60d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:06.574998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a059168-554f-4ea7-a2c6-fa65365fa60d None admin] PATH_INFO: `/v3/projects/216c2f76f14d46fcbc85e84074390e4e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:06.576240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a059168-554f-4ea7-a2c6-fa65365fa60d None admin] RBAC: Authorizing `identity:get_project(project_id=216c2f76f14d46fcbc85e84074390e4e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:06.577731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a059168-554f-4ea7-a2c6-fa65365fa60d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:06.579367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 599/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:08:06 2022] GET /identity/v3/projects/216c2f76f14d46fcbc85e84074390e4e => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:06.587201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392e8c-876d-453c-aad2-fd9014da86c5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:06.691352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392e8c-876d-453c-aad2-fd9014da86c5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:06.726707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8c13-4f45-41f7-a2e3-edddc5af4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:06.727238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8c13-4f45-41f7-a2e3-edddc5af4c44 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:06.727482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8c13-4f45-41f7-a2e3-edddc5af4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:06.727781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8c13-4f45-41f7-a2e3-edddc5af4c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:06.728499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8c13-4f45-41f7-a2e3-edddc5af4c44 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=216c2f76f14d46fcbc85e84074390e4e, user.id=537769630592457791ee996f9368a724) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:08:06.728798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8c13-4f45-41f7-a2e3-edddc5af4c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:06.730250 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8c13-4f45-41f7-a2e3-edddc5af4c44 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:06.735700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 586/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:08:06 2022] GET /identity/v3/role_assignments?user.id=537769630592457791ee996f9368a724&scope.project.id=216c2f76f14d46fcbc85e84074390e4e&role.id=6da07502c09e4fc8afb31b58e434479b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:08.654951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517acc0a-d8b0-41a5-92e2-25e1617ea746 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:08.655408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517acc0a-d8b0-41a5-92e2-25e1617ea746 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:08.655529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517acc0a-d8b0-41a5-92e2-25e1617ea746 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:08.656851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 600/1186] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:08:08.663149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227d5c-7871-4b4e-886f-b312ac61296d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:08.663600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227d5c-7871-4b4e-886f-b312ac61296d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:08.663691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227d5c-7871-4b4e-886f-b312ac61296d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:08.687361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-97227d5c-7871-4b4e-886f-b312ac61296d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:08:08.688566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-97227d5c-7871-4b4e-886f-b312ac61296d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:08:08.743684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:08.772077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 587/1187] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:08:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:08:09.037943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517acc0a-d8b0-41a5-92e2-25e1617ea746 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:09.151899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:09.157054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517acc0a-d8b0-41a5-92e2-25e1617ea746 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:09.196672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86b2a-905c-4ce7-8e00-26fe8c29655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:09.197328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86b2a-905c-4ce7-8e00-26fe8c29655f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:09.197604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86b2a-905c-4ce7-8e00-26fe8c29655f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:09.197876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86b2a-905c-4ce7-8e00-26fe8c29655f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:09.209303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c86b2a-905c-4ce7-8e00-26fe8c29655f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-58c86b2a-905c-4ce7-8e00-26fe8c29655f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:08:09.214102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:08:09.215228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:08:09.216266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 601/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:08:09.221454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97227d5c-7871-4b4e-886f-b312ac61296d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:09.330765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97227d5c-7871-4b4e-886f-b312ac61296d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:09.365953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:09.366552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:09.366829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:09.367094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:09.367754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:08:09.368056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:09.369465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:09.377669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 588/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:09.384208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86b2a-905c-4ce7-8e00-26fe8c29655f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:09.501612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86b2a-905c-4ce7-8e00-26fe8c29655f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:09.537164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ac238-19ba-4913-a29c-c250d39de442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:09.537776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac238-19ba-4913-a29c-c250d39de442 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:09.538049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac238-19ba-4913-a29c-c250d39de442 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:09.538308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac238-19ba-4913-a29c-c250d39de442 None admin] PATH_INFO: `/v3/users/537769630592457791ee996f9368a724` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:09.539524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ac238-19ba-4913-a29c-c250d39de442 None admin] RBAC: Authorizing `identity:get_user(user_id=537769630592457791ee996f9368a724)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:09.540924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ac238-19ba-4913-a29c-c250d39de442 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:09.542513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 602/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:08:09 2022] GET /identity/v3/users/537769630592457791ee996f9368a724 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:09.551847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:09.604565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:09.665299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e368eae-a31a-4ea6-8dcc-8554a84aa468 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:09.700398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dba70f-6ff2-4906-86c8-2e96e52cdef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:09.701022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba70f-6ff2-4906-86c8-2e96e52cdef8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:09.701326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba70f-6ff2-4906-86c8-2e96e52cdef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:09.701594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba70f-6ff2-4906-86c8-2e96e52cdef8 None admin] PATH_INFO: `/v3/projects/216c2f76f14d46fcbc85e84074390e4e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:09.702741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dba70f-6ff2-4906-86c8-2e96e52cdef8 None admin] RBAC: Authorizing `identity:get_project(project_id=216c2f76f14d46fcbc85e84074390e4e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:09.704165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dba70f-6ff2-4906-86c8-2e96e52cdef8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:09.705814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 589/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:08:09 2022] GET /identity/v3/projects/216c2f76f14d46fcbc85e84074390e4e => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:09.712473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ac238-19ba-4913-a29c-c250d39de442 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:09.747016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:09.835635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ac238-19ba-4913-a29c-c250d39de442 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:09.871785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0b3b2-0bc2-4fea-a578-3ecad592cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:09.872366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b3b2-0bc2-4fea-a578-3ecad592cd01 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:09.872641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b3b2-0bc2-4fea-a578-3ecad592cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:09.872914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b3b2-0bc2-4fea-a578-3ecad592cd01 None admin] PATH_INFO: `/v3/projects/216c2f76f14d46fcbc85e84074390e4e/users/537769630592457791ee996f9368a724/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:09.874958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b3b2-0bc2-4fea-a578-3ecad592cd01 None admin] RBAC: Authorizing `identity:create_grant(project_id=216c2f76f14d46fcbc85e84074390e4e, user_id=537769630592457791ee996f9368a724, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:09.876417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0b3b2-0bc2-4fea-a578-3ecad592cd01 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:09.892470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 603/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:08:09 2022] PUT /identity/v3/projects/216c2f76f14d46fcbc85e84074390e4e/users/537769630592457791ee996f9368a724/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:08:11.751945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124f06-1e32-4f91-869f-ddb212de0651 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:11.752809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124f06-1e32-4f91-869f-ddb212de0651 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:11.752809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124f06-1e32-4f91-869f-ddb212de0651 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:11.755032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 590/1193] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:08:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:08:11.763699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0de8a-45cd-49ad-9a26-d57d9a3eadf9 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:11.764123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0de8a-45cd-49ad-9a26-d57d9a3eadf9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:11.764286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0de8a-45cd-49ad-9a26-d57d9a3eadf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:11.786524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8cb0de8a-45cd-49ad-9a26-d57d9a3eadf9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:08:11.787764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8cb0de8a-45cd-49ad-9a26-d57d9a3eadf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:08:11.859443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 604/1194] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:08:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:08:12.125728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee124f06-1e32-4f91-869f-ddb212de0651 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:12.236041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee124f06-1e32-4f91-869f-ddb212de0651 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:12.252635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:12.271827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d3d1-4e3c-4650-a814-98e0c5987270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:12.272463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d3d1-4e3c-4650-a814-98e0c5987270 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:12.272744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d3d1-4e3c-4650-a814-98e0c5987270 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:12.273003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34d3d1-4e3c-4650-a814-98e0c5987270 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:12.283810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34d3d1-4e3c-4650-a814-98e0c5987270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7d34d3d1-4e3c-4650-a814-98e0c5987270 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:08:12.288920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:08:12.290049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:08:12.291107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 591/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:08:12.296244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0de8a-45cd-49ad-9a26-d57d9a3eadf9 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:12.316728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:12.400196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0de8a-45cd-49ad-9a26-d57d9a3eadf9 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:12.441759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:12.442399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:12.442857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:12.443220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:12.443892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:08:12.444193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:12.445589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:12.454893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 605/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:08:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:08:12.461298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d3d1-4e3c-4650-a814-98e0c5987270 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:12.563692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34d3d1-4e3c-4650-a814-98e0c5987270 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:12.600765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683aaef-4824-4b00-b90a-3e9efa40b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:12.601409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683aaef-4824-4b00-b90a-3e9efa40b724 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:12.601686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683aaef-4824-4b00-b90a-3e9efa40b724 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:12.601947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683aaef-4824-4b00-b90a-3e9efa40b724 None admin] PATH_INFO: `/v3/users/537769630592457791ee996f9368a724` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:12.603169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683aaef-4824-4b00-b90a-3e9efa40b724 None admin] RBAC: Authorizing `identity:get_user(user_id=537769630592457791ee996f9368a724)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:12.604587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683aaef-4824-4b00-b90a-3e9efa40b724 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:12.606174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 592/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Aug 31 05:08:12 2022] GET /identity/v3/users/537769630592457791ee996f9368a724 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:12.612926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:12.699775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:12.725374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd56207-16a9-445a-945a-38ec550423aa None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:12.761796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92028-3770-4af2-86cc-3a9b04226f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:12.762396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92028-3770-4af2-86cc-3a9b04226f92 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:12.762673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92028-3770-4af2-86cc-3a9b04226f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:12.762943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92028-3770-4af2-86cc-3a9b04226f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:12.832579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c92028-3770-4af2-86cc-3a9b04226f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:12.834260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c92028-3770-4af2-86cc-3a9b04226f92 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:12.917438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:12.944762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 606/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:08:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:08:12.951001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683aaef-4824-4b00-b90a-3e9efa40b724 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:12.998476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:13.058581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683aaef-4824-4b00-b90a-3e9efa40b724 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:13.093144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39e26a-9eec-4624-abb8-1e7945796500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:13.093786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e26a-9eec-4624-abb8-1e7945796500 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:13.094066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e26a-9eec-4624-abb8-1e7945796500 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:13.094338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39e26a-9eec-4624-abb8-1e7945796500 None admin] PATH_INFO: `/v3/projects/216c2f76f14d46fcbc85e84074390e4e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:13.095583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e26a-9eec-4624-abb8-1e7945796500 None admin] RBAC: Authorizing `identity:get_project(project_id=216c2f76f14d46fcbc85e84074390e4e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:13.097011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39e26a-9eec-4624-abb8-1e7945796500 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:13.098740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 593/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Aug 31 05:08:12 2022] GET /identity/v3/projects/216c2f76f14d46fcbc85e84074390e4e => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:08:13.107967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92028-3770-4af2-86cc-3a9b04226f92 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:08:13.219770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92028-3770-4af2-86cc-3a9b04226f92 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:08:13.258687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644812c-a85c-4dcd-8f68-60cb8aafd3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:08:13.259287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644812c-a85c-4dcd-8f68-60cb8aafd3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:08:13.259559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644812c-a85c-4dcd-8f68-60cb8aafd3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:08:13.259833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644812c-a85c-4dcd-8f68-60cb8aafd3c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:08:13.260557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644812c-a85c-4dcd-8f68-60cb8aafd3c3 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=216c2f76f14d46fcbc85e84074390e4e, user.id=537769630592457791ee996f9368a724) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:08:13.260860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644812c-a85c-4dcd-8f68-60cb8aafd3c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:08:13.262319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644812c-a85c-4dcd-8f68-60cb8aafd3c3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:08:13.268613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 607/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:08:13 2022] GET /identity/v3/role_assignments?user.id=537769630592457791ee996f9368a724&scope.project.id=216c2f76f14d46fcbc85e84074390e4e&role.id=6da07502c09e4fc8afb31b58e434479b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:08:23.088302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=44 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:08:23.265669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=78 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:08.607406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c327-cfdb-4f1e-88b7-732f7efda1b5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:08.608056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c327-cfdb-4f1e-88b7-732f7efda1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:08.608056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c327-cfdb-4f1e-88b7-732f7efda1b5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:08.609535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 594/1201] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:09:08.617533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cca65f-7925-4b0c-9b5d-1392643c3c17 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:08.618068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cca65f-7925-4b0c-9b5d-1392643c3c17 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:08.618431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cca65f-7925-4b0c-9b5d-1392643c3c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:08.647069 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-30cca65f-7925-4b0c-9b5d-1392643c3c17 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:08.648836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-30cca65f-7925-4b0c-9b5d-1392643c3c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:08.761363 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 608/1202] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:09:09.036989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c327-cfdb-4f1e-88b7-732f7efda1b5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:09.166424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c327-cfdb-4f1e-88b7-732f7efda1b5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:09.208197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:09.208863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:09.209197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:09.209494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:09.223158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:09.224872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:09.240962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:09.242318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:09.243585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:09.243585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:09.243585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:09.245409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 595/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:09.248168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cca65f-7925-4b0c-9b5d-1392643c3c17 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:09.377615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cca65f-7925-4b0c-9b5d-1392643c3c17 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:09.425099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:09.431811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488594e-6e2e-4e07-a8d5-4e64e1284284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:09.432445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488594e-6e2e-4e07-a8d5-4e64e1284284 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:09.432747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488594e-6e2e-4e07-a8d5-4e64e1284284 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:09.432986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488594e-6e2e-4e07-a8d5-4e64e1284284 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:09.433719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488594e-6e2e-4e07-a8d5-4e64e1284284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:09.434010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488594e-6e2e-4e07-a8d5-4e64e1284284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:09.435376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488594e-6e2e-4e07-a8d5-4e64e1284284 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:09.453284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 609/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:09.454233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:09.520108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:09.579790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21be847-c261-4962-bae9-665fc70eb89e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:09.634098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c74ad-aa89-4813-824f-4268be69b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:09.635109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c74ad-aa89-4813-824f-4268be69b201 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:09.635578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c74ad-aa89-4813-824f-4268be69b201 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:09.635905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c74ad-aa89-4813-824f-4268be69b201 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:09.636571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c74ad-aa89-4813-824f-4268be69b201 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:09.638049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c74ad-aa89-4813-824f-4268be69b201 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:09.667729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 596/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Aug 31 05:09:09 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:09:11.730199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2452f7-728c-4a76-9115-36ef6b6e61f7 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:11.730774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2452f7-728c-4a76-9115-36ef6b6e61f7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:11.730774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2452f7-728c-4a76-9115-36ef6b6e61f7 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:11.732198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 610/1206] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:11.740529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad99b-c3b7-4092-93f4-52dcdc71c3f4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:11.741196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad99b-c3b7-4092-93f4-52dcdc71c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:11.741196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad99b-c3b7-4092-93f4-52dcdc71c3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:11.763301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7c5ad99b-c3b7-4092-93f4-52dcdc71c3f4 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:11.764862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7c5ad99b-c3b7-4092-93f4-52dcdc71c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:11.843557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 597/1207] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:12.160840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2452f7-728c-4a76-9115-36ef6b6e61f7 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:12.285075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2452f7-728c-4a76-9115-36ef6b6e61f7 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:12.325578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b3c48-a4e3-4ccc-b4fe-cc1b113a705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:12.326297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b3c48-a4e3-4ccc-b4fe-cc1b113a705e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:12.326707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b3c48-a4e3-4ccc-b4fe-cc1b113a705e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:12.326950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b3c48-a4e3-4ccc-b4fe-cc1b113a705e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:12.344390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b3c48-a4e3-4ccc-b4fe-cc1b113a705e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-295b3c48-a4e3-4ccc-b4fe-cc1b113a705e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:09:12.350751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:12.351946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:12.353756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 611/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:09:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:12.358592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad99b-c3b7-4092-93f4-52dcdc71c3f4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:12.409122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:12.488284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad99b-c3b7-4092-93f4-52dcdc71c3f4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:12.527230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:12.527957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:12.528310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:12.528654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:12.529536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:12.529867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:12.531566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:12.541405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 598/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:09:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:09:12.547497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b3c48-a4e3-4ccc-b4fe-cc1b113a705e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:12.609761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:12.686958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b3c48-a4e3-4ccc-b4fe-cc1b113a705e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:12.731688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:12.732380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:12.732557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:12.732831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:12.744192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:12.745648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:12.760653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:12.761885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:12.762947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:12.762947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:12.762947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:12.762947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 612/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:12.768229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:12.888113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:12.891108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86f31b-1d20-4fd3-92d8-7b5bfe8c915e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:12.930007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:12.930624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:12.930910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:12.931162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:12.931803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:12.932106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:12.933507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:12.946441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 599/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:12.952109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:13.061549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39290d3-9350-4285-9fe0-28e68992c55e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:13.062180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:13.099000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:13.099639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:13.099979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:13.100188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:13.111537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:13.113560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:09:13.127080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:13.128224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:13.129527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:13.131916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 613/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:09:13.138838 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:13.256285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d9993-9bce-430b-9b17-5f027c1fea23 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:13.293878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:13.294583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:13.294855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:13.295106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:13.295971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:13.296246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:13.297855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:13.319292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 600/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 31 05:09:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:13.325409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:13.444531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cca9b-7e23-4111-9f04-facd633fea0e None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:13.481504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ae43b-0cae-45af-a004-8225bde0249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:13.482121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ae43b-0cae-45af-a004-8225bde0249b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:13.482398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ae43b-0cae-45af-a004-8225bde0249b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:13.482670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ae43b-0cae-45af-a004-8225bde0249b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:13.519662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:13.568266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ae43b-0cae-45af-a004-8225bde0249b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:13.570163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ae43b-0cae-45af-a004-8225bde0249b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:13.702659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 614/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:09:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:09:13.708721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:13.732053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:13.831085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0e17a-0e06-4acf-afe2-724c3171c9a0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:13.866767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:13.867406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:13.867677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:13.867938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:13.878102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:13.879951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:13.896945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:13.898199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:13.899164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:13.899164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:13.899164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:13.899164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 601/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:09:13.906433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ae43b-0cae-45af-a004-8225bde0249b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:13.990406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:14.029357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ae43b-0cae-45af-a004-8225bde0249b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:14.071735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:14.072372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:14.072648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:14.072943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:14.073633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:14.073902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:14.075267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:14.094771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 615/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:14.095869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:14.171001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:14.204339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50389d9-2a9c-42b9-859f-b58b15ce8c16 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:14.242587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:14.243226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:14.243500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:14.243769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:14.250779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:14.252251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:09:14.264212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:14.269347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:14.271149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 602/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:14.273529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:14.381990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1c6b-4e37-4743-85a8-c92c73062552 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:14.407317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:14.422582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc707bb9-f7ad-45a7-8fee-1757dfe347b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:14.423129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707bb9-f7ad-45a7-8fee-1757dfe347b7 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:14.423412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707bb9-f7ad-45a7-8fee-1757dfe347b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:14.423725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707bb9-f7ad-45a7-8fee-1757dfe347b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:14.424470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc707bb9-f7ad-45a7-8fee-1757dfe347b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:14.424796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc707bb9-f7ad-45a7-8fee-1757dfe347b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:14.426442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc707bb9-f7ad-45a7-8fee-1757dfe347b7 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:14.440046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 616/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:14.447719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:14.558737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54fbc7a-ec0f-41b4-8b2f-4456e6921210 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:14.589382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:14.596529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14eb2-5018-48db-bb6e-ae1249bf3c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:14.597265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14eb2-5018-48db-bb6e-ae1249bf3c0d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:14.597602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14eb2-5018-48db-bb6e-ae1249bf3c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:14.597984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14eb2-5018-48db-bb6e-ae1249bf3c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:14.598953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14eb2-5018-48db-bb6e-ae1249bf3c0d None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=72030c047a444f81ba3c482f99f78486) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:14.599342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14eb2-5018-48db-bb6e-ae1249bf3c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:14.600812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14eb2-5018-48db-bb6e-ae1249bf3c0d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:14.609272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 603/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:09:14 2022] GET /identity/v3/role_assignments?user.id=72030c047a444f81ba3c482f99f78486&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:09:16.608131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca47be-80f2-4bb1-a6a8-7769bdf25837 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:16.608692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca47be-80f2-4bb1-a6a8-7769bdf25837 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:16.608692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca47be-80f2-4bb1-a6a8-7769bdf25837 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:16.610101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 617/1220] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:16.615827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905bfce-da8f-4286-95ed-3b6eca5afa98 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:16.616394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905bfce-da8f-4286-95ed-3b6eca5afa98 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:16.616394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905bfce-da8f-4286-95ed-3b6eca5afa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:16.638063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9905bfce-da8f-4286-95ed-3b6eca5afa98 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:16.639373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9905bfce-da8f-4286-95ed-3b6eca5afa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:16.714824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 604/1221] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:17.025649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca47be-80f2-4bb1-a6a8-7769bdf25837 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:17.145276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca47be-80f2-4bb1-a6a8-7769bdf25837 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:17.185484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8440d2-91d8-42cf-a26a-0c9e18e85f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:17.186250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8440d2-91d8-42cf-a26a-0c9e18e85f22 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:17.186537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8440d2-91d8-42cf-a26a-0c9e18e85f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:17.186872 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8440d2-91d8-42cf-a26a-0c9e18e85f22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:17.198282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8440d2-91d8-42cf-a26a-0c9e18e85f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-ed8440d2-91d8-42cf-a26a-0c9e18e85f22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:09:17.203656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:17.204814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:17.205844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 618/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:09:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:17.211169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905bfce-da8f-4286-95ed-3b6eca5afa98 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:17.319770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905bfce-da8f-4286-95ed-3b6eca5afa98 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:17.345994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:17.359802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:17.360540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:17.360923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:17.361370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:17.362137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:17.362524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:17.364598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:17.374408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 605/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:09:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:17.381763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8440d2-91d8-42cf-a26a-0c9e18e85f22 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:17.428327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:17.490323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8440d2-91d8-42cf-a26a-0c9e18e85f22 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:17.525927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:17.526563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:17.526832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:17.527100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:17.537862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:17.539324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:17.556602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:17.557975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:17.559149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:17.559149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:17.559149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:17.560559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 619/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:09:17.566600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:17.676888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff299de-60be-488f-961e-596ab2cb2b62 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:17.715916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:17.716639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:17.716925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:17.717308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:17.717968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:17.718274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:17.719732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:17.738664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 606/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:17.740005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:17.847672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:17.855190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1b7ec-c1f9-419c-82c5-c8b4eb7f8515 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:17.892060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:17.892683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:17.892993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:17.893322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:17.901946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:17.903858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:09:17.916371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:17.917962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:17.919520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 620/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:09:17.926389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:17.977172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:18.033144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce78182-d6ce-4990-8bdc-4506dfaa299f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:18.070989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:18.071682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:18.071999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:18.072288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:18.073068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:18.073431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:18.075043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:18.094108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 607/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 31 05:09:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:18.100218 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:18.212245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c692b68-9483-4ffc-ad31-24567d647944 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:18.253652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:18.254322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:18.254790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:18.255066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:18.266578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:18.268369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:18.284330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:18.285636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:18.286683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:18.286683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:18.286683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:18.286683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 621/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:09:18.291550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:18.399943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b43e34-0ce2-4717-a3c2-53b02b8fd37e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:18.402299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:18.437853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:18.438562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:18.438841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:18.439111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:18.439755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:18.440057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:18.441459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:18.453291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 608/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:18.459310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:18.469635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:18.570738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d37a71-4215-47dd-a700-fa8f3dd0fe0c None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:18.605921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:18.606545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:18.606824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:18.607087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:18.615484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:18.616941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:09:18.632115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:18.633219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:18.634214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 622/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:09:18.639214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:18.750525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc275e29-0219-4ebc-a191-18bbd8ef9148 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:18.786593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e530647-4bd2-4d1f-a9c4-d9afe84666d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:18.787225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e530647-4bd2-4d1f-a9c4-d9afe84666d4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:18.787502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e530647-4bd2-4d1f-a9c4-d9afe84666d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:18.787767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e530647-4bd2-4d1f-a9c4-d9afe84666d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:18.788449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e530647-4bd2-4d1f-a9c4-d9afe84666d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:18.788758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e530647-4bd2-4d1f-a9c4-d9afe84666d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:18.790236 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e530647-4bd2-4d1f-a9c4-d9afe84666d4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:18.802283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 609/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:18.808435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:18.881540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:18.923085 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b0481-11f0-4864-954d-9cf903cd6a98 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:18.961045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e3ee4-c6cd-41ea-b67b-0a311ac9b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:18.961807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3ee4-c6cd-41ea-b67b-0a311ac9b364 None admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:18.962213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3ee4-c6cd-41ea-b67b-0a311ac9b364 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:18.962491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e3ee4-c6cd-41ea-b67b-0a311ac9b364 None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/72030c047a444f81ba3c482f99f78486/roles/852dcf3bc03949d1990e9200addd3104` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:18.977846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e3ee4-c6cd-41ea-b67b-0a311ac9b364 None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=72030c047a444f81ba3c482f99f78486, role_id=852dcf3bc03949d1990e9200addd3104)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:18.979525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e3ee4-c6cd-41ea-b67b-0a311ac9b364 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:18.992543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 623/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:09:18 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/72030c047a444f81ba3c482f99f78486/roles/852dcf3bc03949d1990e9200addd3104 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:09:20.954148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7518d-91e8-4e88-933d-eaec0c23cb3c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:20.954764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7518d-91e8-4e88-933d-eaec0c23cb3c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:20.954764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7518d-91e8-4e88-933d-eaec0c23cb3c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:20.955908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 610/1233] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:20.961874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ca8e0-81a8-4762-81dc-a285b20f1f38 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:20.962282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ca8e0-81a8-4762-81dc-a285b20f1f38 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:20.962435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ca8e0-81a8-4762-81dc-a285b20f1f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:20.981699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-082ca8e0-81a8-4762-81dc-a285b20f1f38 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:20.982890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-082ca8e0-81a8-4762-81dc-a285b20f1f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:21.058517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 624/1234] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:21.370017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7518d-91e8-4e88-933d-eaec0c23cb3c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:21.399796 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:21.485646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7518d-91e8-4e88-933d-eaec0c23cb3c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:21.522560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73e0b5-6ea3-49c9-9120-f41a6104d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:21.523202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e0b5-6ea3-49c9-9120-f41a6104d6bb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:21.523488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e0b5-6ea3-49c9-9120-f41a6104d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:21.523738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73e0b5-6ea3-49c9-9120-f41a6104d6bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:21.533946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73e0b5-6ea3-49c9-9120-f41a6104d6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-fb73e0b5-6ea3-49c9-9120-f41a6104d6bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:09:21.538708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:21.539849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:21.540871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 611/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Aug 31 05:09:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:09:21.547182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ca8e0-81a8-4762-81dc-a285b20f1f38 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:21.598755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:21.663451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ca8e0-81a8-4762-81dc-a285b20f1f38 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:21.699803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:21.700424 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:21.700703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:21.700976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:21.701682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:21.701987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:21.703364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:21.711842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 625/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Aug 31 05:09:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:21.717728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73e0b5-6ea3-49c9-9120-f41a6104d6bb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:21.815849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:21.833162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73e0b5-6ea3-49c9-9120-f41a6104d6bb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:21.871134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:21.872189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:21.872501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:21.872791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:21.882941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:21.884316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:21.899478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:21.900594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:21.901959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:21.901959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:21.901959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:21.901959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 612/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:21.906933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:22.014729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dfff5-2f0a-4bd7-b280-9bf5268edc9f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:22.024389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:22.052666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:22.053305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:22.053595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:22.053864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:22.054487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:22.054773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:22.056151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:22.068697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 626/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:22.074466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:22.183921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720d3a1-65eb-4ac1-b5f0-5e6b46776303 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:22.225840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:22.226684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:22.226955 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:22.227272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:22.231981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:22.238236 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:22.240297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:09:22.256380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:22.257668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:22.258649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 613/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:22.264057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:22.384075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21a3e6-a198-4a19-8070-178cb23f6075 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:22.420623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:22.421299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:22.421575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:22.421838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:22.422632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:22.422953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:22.424525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:22.442464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 627/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 31 05:09:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:22.448269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:22.587454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3fc95-78e3-4f32-bae2-e93aac4e5642 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:22.632055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd45885-115e-440f-a77c-bad02f96e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:22.632773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd45885-115e-440f-a77c-bad02f96e28d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:22.633076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd45885-115e-440f-a77c-bad02f96e28d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:22.633562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd45885-115e-440f-a77c-bad02f96e28d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:22.712279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:22.720437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd45885-115e-440f-a77c-bad02f96e28d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:22.722056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd45885-115e-440f-a77c-bad02f96e28d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:22.845117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 614/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:09:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 05:09:22.852447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:22.887963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:22.974819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777cd03-c3d4-49d6-9945-f4137f64f3bb None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:23.011372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:23.012011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:23.012287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:23.012550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:23.024954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:23.026606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:23.043552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:23.044697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:23.045754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:23.045754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:23.045754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:23.045754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 628/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:23.051191 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd45885-115e-440f-a77c-bad02f96e28d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:23.161295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:23.168797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd45885-115e-440f-a77c-bad02f96e28d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:23.209771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:23.210653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:23.210976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:23.211250 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:23.211935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:23.212295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:23.213749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:23.227544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 615/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:23.233891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:23.316843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:23.340163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db2f91-4e0d-4cbe-bf8e-3f8c0954f187 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:23.380400 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:23.381073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:23.381380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:23.381649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:23.390079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:23.391733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:09:23.404597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:23.405945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:23.406932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 629/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:23.412395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:23.525650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b564741-0547-418f-b7a3-ba425884edeb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:23.568792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f7eb8-cfd5-47db-a897-d3e0b4538818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:23.569431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7eb8-cfd5-47db-a897-d3e0b4538818 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:23.569712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7eb8-cfd5-47db-a897-d3e0b4538818 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:23.569982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f7eb8-cfd5-47db-a897-d3e0b4538818 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:23.570683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f7eb8-cfd5-47db-a897-d3e0b4538818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:23.570986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f7eb8-cfd5-47db-a897-d3e0b4538818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:23.573131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f7eb8-cfd5-47db-a897-d3e0b4538818 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:23.589050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 616/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:23.595059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:23.714959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769211f4-eb1c-48ca-87fd-b67dc933efd9 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:23.751578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf9e11-7536-46ff-9686-916c01f9a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:23.752185 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9e11-7536-46ff-9686-916c01f9a00f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:23.752467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9e11-7536-46ff-9686-916c01f9a00f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:23.752734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf9e11-7536-46ff-9686-916c01f9a00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:23.753487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf9e11-7536-46ff-9686-916c01f9a00f None admin] RBAC: Adding query filter params (role.id=852dcf3bc03949d1990e9200addd3104, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=72030c047a444f81ba3c482f99f78486) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:23.753855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf9e11-7536-46ff-9686-916c01f9a00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:23.755456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf9e11-7536-46ff-9686-916c01f9a00f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:23.761913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 630/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:09:23 2022] GET /identity/v3/role_assignments?user.id=72030c047a444f81ba3c482f99f78486&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=852dcf3bc03949d1990e9200addd3104 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:26.027901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828937-ffea-4e46-bdfb-ad4cac7b36bd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:26.028414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828937-ffea-4e46-bdfb-ad4cac7b36bd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:26.028504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828937-ffea-4e46-bdfb-ad4cac7b36bd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:26.030168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 617/1247] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:26.036191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e68eb-5f92-4a1d-8d38-3236aa87211b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:26.036669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e68eb-5f92-4a1d-8d38-3236aa87211b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:26.036781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e68eb-5f92-4a1d-8d38-3236aa87211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:26.043687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:26.058178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ed3e68eb-5f92-4a1d-8d38-3236aa87211b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:26.059386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ed3e68eb-5f92-4a1d-8d38-3236aa87211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:26.140750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 631/1248] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 05:09:26.464417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828937-ffea-4e46-bdfb-ad4cac7b36bd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:26.490106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:26.594723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828937-ffea-4e46-bdfb-ad4cac7b36bd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:26.637890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fe7ca-44cd-46b9-81f6-9beb7b6d0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:26.638584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe7ca-44cd-46b9-81f6-9beb7b6d0ffc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:26.639979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe7ca-44cd-46b9-81f6-9beb7b6d0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:26.639979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500fe7ca-44cd-46b9-81f6-9beb7b6d0ffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:26.651191 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500fe7ca-44cd-46b9-81f6-9beb7b6d0ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-500fe7ca-44cd-46b9-81f6-9beb7b6d0ffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:09:26.657556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:26.661387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:26.662335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 618/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:09:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:26.665704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e68eb-5f92-4a1d-8d38-3236aa87211b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:26.779786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e68eb-5f92-4a1d-8d38-3236aa87211b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:26.818259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:26.824167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:26.824952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:26.825332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:26.825611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:26.826319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:26.826780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:26.828404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:26.841114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 632/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:09:26.844602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fe7ca-44cd-46b9-81f6-9beb7b6d0ffc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:26.938796 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:26.973544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500fe7ca-44cd-46b9-81f6-9beb7b6d0ffc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:27.013974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:27.014801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:27.015179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:27.015599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:27.027669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:27.029307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:27.046357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:27.047659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:27.049741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:27.049741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:27.049741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:27.049741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 619/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 05:09:27.054483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:27.181348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7148b-9791-4210-8343-cb63a71c40e3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:27.226488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:27.227279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:27.227494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:27.227811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:27.228782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:27.229159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:27.231193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:27.254573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 633/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:09:27.262170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:27.374252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee3d7c-2f79-48fb-b97d-484ee2483356 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:27.403043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:27.412728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:27.413393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:27.413673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:27.414040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:27.422344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:27.423812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:09:27.436940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:27.438230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:27.439461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 620/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:27.445074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:27.513298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:27.560806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a25ce-d1f9-467e-9a67-64f34f59e5a3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:27.599129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:27.599839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:27.600139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:27.600414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:27.601392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:27.601701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:27.603287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:27.625191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 634/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 31 05:09:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:27.630926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:27.745875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f3e03-eac8-4327-a8ec-03c7c438514a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:27.786479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a7b57-30cf-4ab4-abf0-1cdfaafa30af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:27.787172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a7b57-30cf-4ab4-abf0-1cdfaafa30af None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:27.787453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a7b57-30cf-4ab4-abf0-1cdfaafa30af None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:27.787723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a7b57-30cf-4ab4-abf0-1cdfaafa30af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:27.867372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:27.886466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a7b57-30cf-4ab4-abf0-1cdfaafa30af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:27.887864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a7b57-30cf-4ab4-abf0-1cdfaafa30af None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:28.001331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 621/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:09:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 05:09:28.007496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:28.118664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4df31c-5038-45b6-bc05-e3442ee5489f None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:28.133598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:28.160601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:28.161508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:28.161789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:28.162057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:28.173887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:28.175374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:28.191703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:28.193148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:28.194284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:28.194284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:28.194284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:28.194284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 635/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:28.199777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a7b57-30cf-4ab4-abf0-1cdfaafa30af None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:28.297585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:28.310927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a7b57-30cf-4ab4-abf0-1cdfaafa30af None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:28.350379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:28.351148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:28.351419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:28.351790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:28.352462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:28.352787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:28.354488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:28.370265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 622/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:28.373623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:28.480081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b230-6915-42bf-ba87-ae2a9643ecf6 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:28.520414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:28.521212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:28.521627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:28.521988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:28.529396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:28.530944 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:09:28.544143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:28.545353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:28.546510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:09:28.546510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:09:28.546510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:09:28.546510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:09:28.546510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:09:28.546510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:09:28.546510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:28.546510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:28.550819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 636/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:28.552125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:28.661011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681071b-f3b5-4f44-8501-66521da83694 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:28.697881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f03f67-de26-4ca9-90a6-f685fb68b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:28.698517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03f67-de26-4ca9-90a6-f685fb68b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:28.698788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03f67-de26-4ca9-90a6-f685fb68b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:28.699082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f03f67-de26-4ca9-90a6-f685fb68b2b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:28.699766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f03f67-de26-4ca9-90a6-f685fb68b2b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:28.700109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f03f67-de26-4ca9-90a6-f685fb68b2b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:28.702101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f03f67-de26-4ca9-90a6-f685fb68b2b1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:28.715265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 623/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:28.722009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:28.750319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:28.827853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccaffc-6517-4f92-90d6-2a3f48db8ea4 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:28.864773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06cf18-036c-40ad-9ffb-c607bd143fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:28.865445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06cf18-036c-40ad-9ffb-c607bd143fbb None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:28.865722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06cf18-036c-40ad-9ffb-c607bd143fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:28.865998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06cf18-036c-40ad-9ffb-c607bd143fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:28.866820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06cf18-036c-40ad-9ffb-c607bd143fbb None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=72030c047a444f81ba3c482f99f78486) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:28.867129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06cf18-036c-40ad-9ffb-c607bd143fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:28.868728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06cf18-036c-40ad-9ffb-c607bd143fbb None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:28.874833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 637/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:09:28 2022] GET /identity/v3/role_assignments?user.id=72030c047a444f81ba3c482f99f78486&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=6da07502c09e4fc8afb31b58e434479b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:30.753517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff7cc-6fc5-4965-bb15-f870696dfbe6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:30.754108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff7cc-6fc5-4965-bb15-f870696dfbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:30.754108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ff7cc-6fc5-4965-bb15-f870696dfbe6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:30.755441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 624/1261] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:30.761729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8323d7-52ee-485b-a3b2-101598d58efb None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:30.762446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8323d7-52ee-485b-a3b2-101598d58efb None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:30.762587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8323d7-52ee-485b-a3b2-101598d58efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:30.786046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-cd8323d7-52ee-485b-a3b2-101598d58efb None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:30.787243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-cd8323d7-52ee-485b-a3b2-101598d58efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:30.858895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 638/1262] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:31.121525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff7cc-6fc5-4965-bb15-f870696dfbe6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:31.134351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:31.239826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ff7cc-6fc5-4965-bb15-f870696dfbe6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:31.279794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7dfe1-697e-4ddb-93e0-19bab91cea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:31.280423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dfe1-697e-4ddb-93e0-19bab91cea10 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:31.280697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dfe1-697e-4ddb-93e0-19bab91cea10 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:31.280962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dfe1-697e-4ddb-93e0-19bab91cea10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:31.291604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7dfe1-697e-4ddb-93e0-19bab91cea10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9ff7dfe1-697e-4ddb-93e0-19bab91cea10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:09:31.296340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:31.297457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:31.298678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 625/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:31.304479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8323d7-52ee-485b-a3b2-101598d58efb None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:31.333303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:31.418681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8323d7-52ee-485b-a3b2-101598d58efb None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:31.454798 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:31.455388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:31.455659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:31.455921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:31.456568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:31.456860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:31.458302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:31.466465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 639/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:31.472255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7dfe1-697e-4ddb-93e0-19bab91cea10 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:31.555212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:31.591759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7dfe1-697e-4ddb-93e0-19bab91cea10 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:31.628421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:31.629123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:31.629559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:31.629961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:31.640725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:31.642539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:31.657460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:31.658529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:31.659812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:31.659812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:31.659812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:31.659812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 626/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:31.664509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:31.749724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:31.774517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981a98-d4fc-46c3-805d-7ae5a3ae04a2 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:31.812137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:31.812731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:31.813006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:31.813307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:31.813940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:31.814240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:31.815588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:31.827459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 640/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:31.836653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:31.945285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab2ef-5612-4073-8a6f-7a9beff95dc3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:31.965123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:31.984036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:31.984662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:31.984941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:31.985248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:31.994238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:31.995684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:09:32.006982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:32.008090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:32.009489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 627/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:32.016410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:32.125817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e181-510d-4625-9f6c-f9cf38d10dfe None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:32.164715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:32.165372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:32.165755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:32.166075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:32.166986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:32.167287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:32.168814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:32.179096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:32.189874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 641/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 31 05:09:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:32.196293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:32.309948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddf2d-801e-4b2e-9659-8abce99fed5b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:32.344951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:32.345599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:32.345874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:32.346144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:32.357537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:32.358983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:32.373296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:32.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:32.375474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:32.375474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:32.375474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:32.377444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 628/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:32.380296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:32.487908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53124e40-3249-4b72-b65e-ad57439b1041 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:32.524379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:32.524970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:32.525279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:32.525546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:32.526181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:32.526483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:32.527835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:32.539548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 642/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:32.545329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:32.578151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:32.657724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f8ab-95cb-4b18-a78f-173ba13833c8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:32.690766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:32.691380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:32.691730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:32.692025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:32.698574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:32.699991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:09:32.711014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:32.712064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:32.713160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 629/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:09:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:32.718680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:32.779153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:32.822704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b11158-c0b1-4af2-bc0b-1e8cf8c55008 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:32.858254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da2352-a4fa-4125-bf2b-80b3d607d1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:32.858789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da2352-a4fa-4125-bf2b-80b3d607d1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:32.859064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da2352-a4fa-4125-bf2b-80b3d607d1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:32.859335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da2352-a4fa-4125-bf2b-80b3d607d1a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:32.860028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da2352-a4fa-4125-bf2b-80b3d607d1a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:32.860335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da2352-a4fa-4125-bf2b-80b3d607d1a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:32.861789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da2352-a4fa-4125-bf2b-80b3d607d1a4 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:32.873854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 643/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:09:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:32.880047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:32.987924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:32.997953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bda9d-70d9-4721-a5e3-3a6d786a6604 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:33.033065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d28e4-ad5e-4092-885b-2fca28d55642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:33.033747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d28e4-ad5e-4092-885b-2fca28d55642 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:33.034027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d28e4-ad5e-4092-885b-2fca28d55642 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:33.034294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d28e4-ad5e-4092-885b-2fca28d55642 None admin] PATH_INFO: `/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/72030c047a444f81ba3c482f99f78486/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:33.036500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d28e4-ad5e-4092-885b-2fca28d55642 None admin] RBAC: Authorizing `identity:create_grant(project_id=155ef0966d5d4b3e80dd5bec11edd729, user_id=72030c047a444f81ba3c482f99f78486, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:33.037960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d28e4-ad5e-4092-885b-2fca28d55642 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:33.052979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 630/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Aug 31 05:09:32 2022] PUT /identity/v3/projects/155ef0966d5d4b3e80dd5bec11edd729/users/72030c047a444f81ba3c482f99f78486/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:09:34.912308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908dd62-1898-4bb8-a862-23d94e381ce2 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:34.912881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908dd62-1898-4bb8-a862-23d94e381ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:34.912881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908dd62-1898-4bb8-a862-23d94e381ce2 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:34.914112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 644/1274] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:34.922826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fdda8-cf89-4825-9267-27ff64ee7243 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:34.923494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fdda8-cf89-4825-9267-27ff64ee7243 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:34.923733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fdda8-cf89-4825-9267-27ff64ee7243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:34.950393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3a4fdda8-cf89-4825-9267-27ff64ee7243 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:34.951636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3a4fdda8-cf89-4825-9267-27ff64ee7243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:35.024279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 631/1275] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:35.290542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908dd62-1898-4bb8-a862-23d94e381ce2 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:35.410479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908dd62-1898-4bb8-a862-23d94e381ce2 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:35.427668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:35.445628 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff942ac-76bd-412d-bc63-63bebd4fb0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:35.446249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff942ac-76bd-412d-bc63-63bebd4fb0ff None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:35.446532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff942ac-76bd-412d-bc63-63bebd4fb0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:35.446803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff942ac-76bd-412d-bc63-63bebd4fb0ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:35.456839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff942ac-76bd-412d-bc63-63bebd4fb0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-8ff942ac-76bd-412d-bc63-63bebd4fb0ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 05:09:35.461681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:35.462898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:35.464066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 645/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Aug 31 05:09:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:35.469104 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fdda8-cf89-4825-9267-27ff64ee7243 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:35.559479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:35.582408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fdda8-cf89-4825-9267-27ff64ee7243 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:35.621408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:35.622209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:35.622362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:35.622550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:35.623221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:35.623521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:35.624925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:35.633886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 632/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Aug 31 05:09:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:35.640113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff942ac-76bd-412d-bc63-63bebd4fb0ff None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:35.745117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff942ac-76bd-412d-bc63-63bebd4fb0ff None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:35.780104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:35.780702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:35.780978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:35.781273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:35.791276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:35.792700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:35.807267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:35.808392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:35.809676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:35.809676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:35.809676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:35.809676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 646/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:35.814482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:35.929123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484451ab-4899-44d0-a4a2-7356f21e85d7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:35.964743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:35.965367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:35.965648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:35.965915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:35.966552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:35.966881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:35.968208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:35.981338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 633/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:09:35.990255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:36.029043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:36.100207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f640d-e0a7-4e47-998b-fb58475713ed None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:36.136563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:36.137196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:36.137472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:36.137734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:36.145805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:36.147227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 05:09:36.159377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:36.160831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:36.162214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 647/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:36.166934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:36.170995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:36.276499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f37f4-cf58-45c0-a454-ae340b3865af None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:36.311841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:36.312433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:36.312703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:36.312966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:36.313712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:36.314014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:36.315422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:36.332499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 634/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Aug 31 05:09:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:36.338344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:36.436637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:36.446457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d090b-f98f-423a-824e-eccd3cc0265b None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:36.484968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbf47-25e2-4a2e-a3ff-27f283252b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:36.485614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbf47-25e2-4a2e-a3ff-27f283252b97 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:36.486032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbf47-25e2-4a2e-a3ff-27f283252b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:36.486302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbf47-25e2-4a2e-a3ff-27f283252b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:36.559968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cbf47-25e2-4a2e-a3ff-27f283252b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:36.561432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cbf47-25e2-4a2e-a3ff-27f283252b97 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:36.654852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:36.670873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 648/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Aug 31 05:09:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 05:09:36.677263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:36.739963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:36.789502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b595f9-2ae8-4dae-8d85-f24a3dacbbaf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:36.823767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:36.824382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:36.824654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:36.824920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:36.835801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:36.837255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 05:09:36.852861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:36.853986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 05:09:36.855075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 05:09:36.855075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 05:09:36.855075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:36.855075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 635/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:36.862065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbf47-25e2-4a2e-a3ff-27f283252b97 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:36.981718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbf47-25e2-4a2e-a3ff-27f283252b97 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:37.019421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:37.020202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:37.020202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:37.020491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:37.021124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:37.021441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:37.022782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:37.033948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 649/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Aug 31 05:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:37.040730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:37.169183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0fc9-3344-4f1d-a020-6cd2cb7dc907 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:37.183551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:37.204501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:37.205152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:37.205432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:37.205702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:37.212541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:37.214044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 05:09:37.226457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:37.227502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 31 05:09:37.228451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 636/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Aug 31 05:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:37.233857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:37.283847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:37.341018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f7ba2-3e2e-4c96-8147-edee98049c85 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:37.376436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d513e-ab3b-4698-add6-87435b226d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:37.377027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d513e-ab3b-4698-add6-87435b226d3d None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:37.377337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d513e-ab3b-4698-add6-87435b226d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:37.377601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d513e-ab3b-4698-add6-87435b226d3d None admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:37.378291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d513e-ab3b-4698-add6-87435b226d3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:37.378593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d513e-ab3b-4698-add6-87435b226d3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:37.380270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d513e-ab3b-4698-add6-87435b226d3d None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:37.393739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 650/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Aug 31 05:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:37.403131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:37.509464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b496bc3-71c9-425e-8469-56d46f958d64 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:37.545140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8f2f2-299c-417d-9dd7-4ca8e432a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:37.545679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8f2f2-299c-417d-9dd7-4ca8e432a253 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:37.545952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8f2f2-299c-417d-9dd7-4ca8e432a253 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:37.546217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8f2f2-299c-417d-9dd7-4ca8e432a253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:37.546942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8f2f2-299c-417d-9dd7-4ca8e432a253 None admin] RBAC: Adding query filter params (role.id=6da07502c09e4fc8afb31b58e434479b, scope.project.id=155ef0966d5d4b3e80dd5bec11edd729, user.id=72030c047a444f81ba3c482f99f78486) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:37.547245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8f2f2-299c-417d-9dd7-4ca8e432a253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:37.548678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8f2f2-299c-417d-9dd7-4ca8e432a253 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:37.554803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 637/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Aug 31 05:09:37 2022] GET /identity/v3/role_assignments?user.id=72030c047a444f81ba3c482f99f78486&scope.project.id=155ef0966d5d4b3e80dd5bec11edd729&role.id=6da07502c09e4fc8afb31b58e434479b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:39.475289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3062-f795-434b-a41e-94a9e7a51d8f None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:39.476189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3062-f795-434b-a41e-94a9e7a51d8f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:39.476189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3062-f795-434b-a41e-94a9e7a51d8f None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:39.478415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 651/1288] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:39.484684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009a49-5fdd-4426-8646-675f6c08017a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:39.485146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009a49-5fdd-4426-8646-675f6c08017a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:39.485280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009a49-5fdd-4426-8646-675f6c08017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:39.515327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d1009a49-5fdd-4426-8646-675f6c08017a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:39.517570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d1009a49-5fdd-4426-8646-675f6c08017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:39.553393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:39.605487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 638/1289] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:39.876971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee3062-f795-434b-a41e-94a9e7a51d8f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:39.984625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee3062-f795-434b-a41e-94a9e7a51d8f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:40.001780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:40.027260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:40.027884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:40.028159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:40.028429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:40.029011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:40.030410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:40.039305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:40.040704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:40.042418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 652/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:09:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:40.049765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1009a49-5fdd-4426-8646-675f6c08017a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:40.153884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1009a49-5fdd-4426-8646-675f6c08017a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:40.192602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdeb01-8edf-410e-b73b-a086f8f83de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:40.193318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdeb01-8edf-410e-b73b-a086f8f83de1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:40.193603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdeb01-8edf-410e-b73b-a086f8f83de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:40.193868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdeb01-8edf-410e-b73b-a086f8f83de1 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:40.194567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdeb01-8edf-410e-b73b-a086f8f83de1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:40.194941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdeb01-8edf-410e-b73b-a086f8f83de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:40.196350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdeb01-8edf-410e-b73b-a086f8f83de1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:40.202224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 639/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 31 05:09:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:40.209235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:40.316828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef0de-76bc-43ac-a59b-2b3112eeadc2 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:40.351246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790192c7-b6cb-458c-9680-7e872ec66b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:40.351838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790192c7-b6cb-458c-9680-7e872ec66b43 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:40.352112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790192c7-b6cb-458c-9680-7e872ec66b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:40.352376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790192c7-b6cb-458c-9680-7e872ec66b43 None admin] PATH_INFO: `/v3/services` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:40.352995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790192c7-b6cb-458c-9680-7e872ec66b43 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:40.353323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790192c7-b6cb-458c-9680-7e872ec66b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:40.354695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790192c7-b6cb-458c-9680-7e872ec66b43 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:40.359385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 653/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 31 05:09:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:42.213380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9c24-0218-409b-a170-95166398b364 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:42.214236 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9c24-0218-409b-a170-95166398b364 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:42.214236 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9c24-0218-409b-a170-95166398b364 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:42.216347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 640/1293] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:42.222693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201da3f-8944-4fad-a9aa-c70294b8e069 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:42.223256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201da3f-8944-4fad-a9aa-c70294b8e069 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:42.223704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201da3f-8944-4fad-a9aa-c70294b8e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:42.253700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-5201da3f-8944-4fad-a9aa-c70294b8e069 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:42.255618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5201da3f-8944-4fad-a9aa-c70294b8e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:42.298117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:42.339016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 654/1294] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:42.600265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9c24-0218-409b-a170-95166398b364 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:42.646125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:42.721617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a9c24-0218-409b-a170-95166398b364 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:42.756767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887972d-19b1-4255-9b01-83ef4343194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:42.757394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887972d-19b1-4255-9b01-83ef4343194b None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:42.757705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887972d-19b1-4255-9b01-83ef4343194b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:42.757971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887972d-19b1-4255-9b01-83ef4343194b None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:42.758640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887972d-19b1-4255-9b01-83ef4343194b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:42.760005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887972d-19b1-4255-9b01-83ef4343194b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:42.782408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 641/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Aug 31 05:09:42 2022] POST /identity/v3/services => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:09:44.707772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e41be1-e9c5-4111-a470-601c4e1cb37e None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:44.708310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e41be1-e9c5-4111-a470-601c4e1cb37e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:44.708310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e41be1-e9c5-4111-a470-601c4e1cb37e None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:44.709698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 655/1296] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:44.715906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945a920-1ba7-4496-9abe-46129dc786b6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:44.716682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945a920-1ba7-4496-9abe-46129dc786b6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:44.716834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945a920-1ba7-4496-9abe-46129dc786b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:44.738499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e945a920-1ba7-4496-9abe-46129dc786b6 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:44.739700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e945a920-1ba7-4496-9abe-46129dc786b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:44.817005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 642/1297] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:45.086534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e41be1-e9c5-4111-a470-601c4e1cb37e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:45.208959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e41be1-e9c5-4111-a470-601c4e1cb37e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:45.253274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:45.254491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:45.254787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:45.255130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:45.255692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:45.257061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:45.266303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:45.267906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:45.268789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 656/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:09:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:45.274276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945a920-1ba7-4496-9abe-46129dc786b6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:45.293217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:45.383405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945a920-1ba7-4496-9abe-46129dc786b6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:45.420045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:45.420652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:45.420928 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:45.421227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:45.421865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] RBAC: Adding query filter params (name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:45.422172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:45.423573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:45.428872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 643/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 31 05:09:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:45.435288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:45.474396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:45.546036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ba819-08ae-47d3-9cd3-b27735cf46a2 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:45.591080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92890515-eebf-4f2e-9386-81c2bc421752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:45.591690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890515-eebf-4f2e-9386-81c2bc421752 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:45.591974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890515-eebf-4f2e-9386-81c2bc421752 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:45.592244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890515-eebf-4f2e-9386-81c2bc421752 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:45.592952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890515-eebf-4f2e-9386-81c2bc421752 None admin] RBAC: Adding query filter params (interface=public, service_id=f7f015db373247118d9b62c7ce687684, region_id=RegionOne) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:45.593292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890515-eebf-4f2e-9386-81c2bc421752 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:45.594672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890515-eebf-4f2e-9386-81c2bc421752 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:45.599916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 657/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Aug 31 05:09:45 2022] GET /identity/v3/endpoints?service_id=f7f015db373247118d9b62c7ce687684&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:09:45.606975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:45.695836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:45.717704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615535d-caf9-4b01-8e56-9bfedf7a74af None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:45.754457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484821e-a173-4ba7-92c7-90779354e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:45.755078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484821e-a173-4ba7-92c7-90779354e04d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:45.755360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484821e-a173-4ba7-92c7-90779354e04d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:45.755631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484821e-a173-4ba7-92c7-90779354e04d None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:45.756240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484821e-a173-4ba7-92c7-90779354e04d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:45.757647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484821e-a173-4ba7-92c7-90779354e04d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:45.764540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 644/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Aug 31 05:09:45 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:09:47.621973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35412-a2f3-4566-8fd8-bb1052101c15 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:47.622547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35412-a2f3-4566-8fd8-bb1052101c15 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:47.622547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c35412-a2f3-4566-8fd8-bb1052101c15 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:47.623859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 658/1302] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:09:47.629458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad408f3-6da5-4642-833b-9c86f0eda444 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:47.629843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad408f3-6da5-4642-833b-9c86f0eda444 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:47.629843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad408f3-6da5-4642-833b-9c86f0eda444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:47.648580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8ad408f3-6da5-4642-833b-9c86f0eda444 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:09:47.649771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8ad408f3-6da5-4642-833b-9c86f0eda444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:09:47.717711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 645/1303] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:09:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 05:09:47.978878 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35412-a2f3-4566-8fd8-bb1052101c15 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:48.083548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:48.095463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c35412-a2f3-4566-8fd8-bb1052101c15 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:48.137910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:48.138529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:48.138808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:48.139087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:48.139665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:48.141014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 05:09:48.150459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 05:09:48.153342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application with Lock( Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self._enter() Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application return self.creator() Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application created_value = creator( Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: ERROR keystone.server.flask.application Aug 31 05:09:48.154365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 659/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Aug 31 05:09:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 05:09:48.159506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad408f3-6da5-4642-833b-9c86f0eda444 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:48.262069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:48.287200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad408f3-6da5-4642-833b-9c86f0eda444 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:48.326148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbebce4-2ebc-4ff0-98fe-f55c865ad150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:48.326750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbebce4-2ebc-4ff0-98fe-f55c865ad150 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:48.327027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbebce4-2ebc-4ff0-98fe-f55c865ad150 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:48.327294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbebce4-2ebc-4ff0-98fe-f55c865ad150 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:48.327917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbebce4-2ebc-4ff0-98fe-f55c865ad150 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:09:48.328209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbebce4-2ebc-4ff0-98fe-f55c865ad150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:48.329596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbebce4-2ebc-4ff0-98fe-f55c865ad150 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:48.335088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 646/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Aug 31 05:09:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:09:48.341184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:09:48.443982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af46a6-08db-4bdb-934d-09c702f16cf3 None admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:09:48.478215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7a575-fa2b-49ee-8b2b-9afa56352fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:09:48.478800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a575-fa2b-49ee-8b2b-9afa56352fb5 None admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:09:48.479078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a575-fa2b-49ee-8b2b-9afa56352fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:09:48.479345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7a575-fa2b-49ee-8b2b-9afa56352fb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:09:48.480012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7a575-fa2b-49ee-8b2b-9afa56352fb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:09:48.481445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7a575-fa2b-49ee-8b2b-9afa56352fb5 None admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:09:48.505176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 660/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:09:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:09:58.335083 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=30 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:09:58.498994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:10:52.344013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe40e04-3fe6-4336-8d92-663962cb1a4b None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:52.344941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe40e04-3fe6-4336-8d92-663962cb1a4b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:52.345387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe40e04-3fe6-4336-8d92-663962cb1a4b None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:52.352645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabdd2b-872e-46f2-8352-6bdd3bf17fae None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:52.353455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabdd2b-872e-46f2-8352-6bdd3bf17fae None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:52.353887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabdd2b-872e-46f2-8352-6bdd3bf17fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:52.357427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 647/1307] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:10:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:10:52.439136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-3cabdd2b-872e-46f2-8352-6bdd3bf17fae None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:10:52.440587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3cabdd2b-872e-46f2-8352-6bdd3bf17fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:52.561170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 661/1308] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:10:52.864401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760036-b0e4-4185-8ca9-fed554ef7f39 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:52.864708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760036-b0e4-4185-8ca9-fed554ef7f39 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:52.864964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760036-b0e4-4185-8ca9-fed554ef7f39 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:52.866583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 648/1309] 10.222.0.17 () {54 vars in 965 bytes} [Wed Aug 31 05:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:10:52.873428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534194-0a54-42f5-ac66-691bb339f2fb None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:52.873782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534194-0a54-42f5-ac66-691bb339f2fb None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:52.873984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1534194-0a54-42f5-ac66-691bb339f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:52.968954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b1534194-0a54-42f5-ac66-691bb339f2fb None None] MFA Rules not processed for user `45dadcdc0903427ca598dcd0bf06a6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:10:52.970200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b1534194-0a54-42f5-ac66-691bb339f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:52.991933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:10:53.050790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 662/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Aug 31 05:10:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:10:53.060476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760036-b0e4-4185-8ca9-fed554ef7f39 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:10:53.062275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cd760036-b0e4-4185-8ca9-fed554ef7f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:53.175820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760036-b0e4-4185-8ca9-fed554ef7f39 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:10:53.259339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793efe3-af0b-40f8-8040-2de979049c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:10:53.259965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793efe3-af0b-40f8-8040-2de979049c58 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:53.260270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793efe3-af0b-40f8-8040-2de979049c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:53.260550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793efe3-af0b-40f8-8040-2de979049c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:53.262239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8793efe3-af0b-40f8-8040-2de979049c58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:53.324691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:10:53.386323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793efe3-af0b-40f8-8040-2de979049c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:10:53.387741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793efe3-af0b-40f8-8040-2de979049c58 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:10:53.407001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 649/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:10:55.569667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5d089-25e7-40a9-a679-87a8fb76e6ec None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:55.570270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5d089-25e7-40a9-a679-87a8fb76e6ec None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:55.570270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5d089-25e7-40a9-a679-87a8fb76e6ec None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:55.571834 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 663/1312] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:10:55.577351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ea88-af01-4914-8f75-d1a8804a12a3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:55.577938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ea88-af01-4914-8f75-d1a8804a12a3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:55.577938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208ea88-af01-4914-8f75-d1a8804a12a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:55.665616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1208ea88-af01-4914-8f75-d1a8804a12a3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:10:55.666877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1208ea88-af01-4914-8f75-d1a8804a12a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:55.773104 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 650/1313] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:10:56.061754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5d089-25e7-40a9-a679-87a8fb76e6ec None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:10:56.064214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1db5d089-25e7-40a9-a679-87a8fb76e6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:56.184698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5d089-25e7-40a9-a679-87a8fb76e6ec None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:10:56.259862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:10:56.263054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4816b-4c7e-4d3d-828a-58735db52270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:10:56.263945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4816b-4c7e-4d3d-828a-58735db52270 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:56.264204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4816b-4c7e-4d3d-828a-58735db52270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:56.264611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4816b-4c7e-4d3d-828a-58735db52270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:56.268333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-87b4816b-4c7e-4d3d-828a-58735db52270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:56.387972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4816b-4c7e-4d3d-828a-58735db52270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:10:56.389429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4816b-4c7e-4d3d-828a-58735db52270 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:10:56.409489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 664/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:10:58.650277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04121fc-5c98-4037-979a-86b25c41f5ec None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:58.650823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04121fc-5c98-4037-979a-86b25c41f5ec None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:58.650823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04121fc-5c98-4037-979a-86b25c41f5ec None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:58.652256 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 651/1315] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:10:58.658044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726848e-c8fc-49b6-a5cd-f003a911744d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:58.658493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726848e-c8fc-49b6-a5cd-f003a911744d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:58.658682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726848e-c8fc-49b6-a5cd-f003a911744d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:58.727927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f726848e-c8fc-49b6-a5cd-f003a911744d None None] MFA Rules not processed for user `6ec03fbc1019458b83bcc0af6fb04ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:10:58.729180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f726848e-c8fc-49b6-a5cd-f003a911744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:58.790545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:10:58.835698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 665/1316] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:10:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:10:59.117734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04121fc-5c98-4037-979a-86b25c41f5ec None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:10:59.120231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a04121fc-5c98-4037-979a-86b25c41f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:59.133639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:10:59.237526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04121fc-5c98-4037-979a-86b25c41f5ec None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:10:59.314478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6c75f-4163-4958-a9ef-4c5520f9eb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:10:59.315077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6c75f-4163-4958-a9ef-4c5520f9eb9a service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:10:59.315351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6c75f-4163-4958-a9ef-4c5520f9eb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:10:59.315618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6c75f-4163-4958-a9ef-4c5520f9eb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:10:59.317585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f3e6c75f-4163-4958-a9ef-4c5520f9eb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:10:59.386935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:10:59.436196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6c75f-4163-4958-a9ef-4c5520f9eb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:10:59.437728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6c75f-4163-4958-a9ef-4c5520f9eb9a service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:10:59.459051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 652/1317] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:10:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:01.910200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468be4-dcaf-48b3-996f-6c47b389675d None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:01.911008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468be4-dcaf-48b3-996f-6c47b389675d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:01.911008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468be4-dcaf-48b3-996f-6c47b389675d None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:01.913070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 666/1318] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:01.921009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657149f-5150-4c10-9a70-82720d04e7cb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:01.921513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657149f-5150-4c10-9a70-82720d04e7cb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:01.921619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657149f-5150-4c10-9a70-82720d04e7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:01.988984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e657149f-5150-4c10-9a70-82720d04e7cb None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:01.990277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e657149f-5150-4c10-9a70-82720d04e7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:02.092171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 653/1319] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:11:02.380079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b468be4-dcaf-48b3-996f-6c47b389675d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:02.382518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3b468be4-dcaf-48b3-996f-6c47b389675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:02.510039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b468be4-dcaf-48b3-996f-6c47b389675d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:02.586370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbe8dc-b645-4748-bc8b-bd74d50a0755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:02.586964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe8dc-b645-4748-bc8b-bd74d50a0755 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:02.587234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe8dc-b645-4748-bc8b-bd74d50a0755 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:02.587493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe8dc-b645-4748-bc8b-bd74d50a0755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:02.589105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f0dbe8dc-b645-4748-bc8b-bd74d50a0755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:02.596405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:02.707556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbe8dc-b645-4748-bc8b-bd74d50a0755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:02.708989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbe8dc-b645-4748-bc8b-bd74d50a0755 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:02.728927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 667/1320] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:05.296015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f246c-553f-4d1e-bb5d-a0e53d3ce809 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:05.296576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f246c-553f-4d1e-bb5d-a0e53d3ce809 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:05.296576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f246c-553f-4d1e-bb5d-a0e53d3ce809 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:05.297946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 654/1321] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:05.303370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6c57-e17c-4212-b443-8eeafb41f15d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:05.303818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6c57-e17c-4212-b443-8eeafb41f15d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:05.303926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c6c57-e17c-4212-b443-8eeafb41f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:05.373607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-c96c6c57-e17c-4212-b443-8eeafb41f15d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:05.374807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c96c6c57-e17c-4212-b443-8eeafb41f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:05.434399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:05.477703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 668/1322] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:05.774069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed88e-b389-41e9-969b-6feb5039978f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:05.774324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed88e-b389-41e9-969b-6feb5039978f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:05.774625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed88e-b389-41e9-969b-6feb5039978f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:05.775960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 655/1323] 10.222.0.17 () {54 vars in 965 bytes} [Wed Aug 31 05:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:05.782791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a9f1c-565f-42de-93e2-aa7b0ab106c3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:05.783075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a9f1c-565f-42de-93e2-aa7b0ab106c3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:05.783341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a9f1c-565f-42de-93e2-aa7b0ab106c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:05.861303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b64a9f1c-565f-42de-93e2-aa7b0ab106c3 None None] MFA Rules not processed for user `45dadcdc0903427ca598dcd0bf06a6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:05.862566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b64a9f1c-565f-42de-93e2-aa7b0ab106c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:05.941901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 669/1324] 10.222.0.17 () {58 vars in 1062 bytes} [Wed Aug 31 05:11:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:05.951156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed88e-b389-41e9-969b-6feb5039978f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:05.952619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0d7ed88e-b389-41e9-969b-6feb5039978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:05.973314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:06.064148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed88e-b389-41e9-969b-6feb5039978f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:06.140270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a2b7-4797-4153-a3cd-009fa428682d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:06.140876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a2b7-4797-4153-a3cd-009fa428682d service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:06.141188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a2b7-4797-4153-a3cd-009fa428682d service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:06.141455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a2b7-4797-4153-a3cd-009fa428682d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:06.143078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1b62a2b7-4797-4153-a3cd-009fa428682d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:06.215220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:06.254123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62a2b7-4797-4153-a3cd-009fa428682d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:06.255453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62a2b7-4797-4153-a3cd-009fa428682d service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:06.274347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 656/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:08.448272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c8eb7-14e9-42ab-b766-d88b2a90d31d None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:08.448892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c8eb7-14e9-42ab-b766-d88b2a90d31d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:08.448892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c8eb7-14e9-42ab-b766-d88b2a90d31d None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:08.450199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 670/1326] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:08.455615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f064c-76b5-442f-97ca-e40ac1233111 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:08.456070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f064c-76b5-442f-97ca-e40ac1233111 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:08.456172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f064c-76b5-442f-97ca-e40ac1233111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:08.524253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8a8f064c-76b5-442f-97ca-e40ac1233111 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:08.525520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8a8f064c-76b5-442f-97ca-e40ac1233111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:08.654525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 657/1327] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:08.935756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c8eb7-14e9-42ab-b766-d88b2a90d31d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:08.937338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-cb8c8eb7-14e9-42ab-b766-d88b2a90d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:09.010879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:09.063600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c8eb7-14e9-42ab-b766-d88b2a90d31d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:09.158933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e70d07-f3b2-430f-98c8-095f9c35d5d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:09.159619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e70d07-f3b2-430f-98c8-095f9c35d5d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:09.159898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e70d07-f3b2-430f-98c8-095f9c35d5d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:09.160162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e70d07-f3b2-430f-98c8-095f9c35d5d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:09.161829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-79e70d07-f3b2-430f-98c8-095f9c35d5d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:09.286961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:09.289788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e70d07-f3b2-430f-98c8-095f9c35d5d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:09.291737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e70d07-f3b2-430f-98c8-095f9c35d5d7 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:09.312712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 671/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:11.348871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a41d1-633d-4167-bd7a-ee1a16a6a4b1 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:11.349396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a41d1-633d-4167-bd7a-ee1a16a6a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:11.349506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a41d1-633d-4167-bd7a-ee1a16a6a4b1 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:11.350828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 658/1329] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:11.356444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec2ef-e462-442a-8a3d-e6bbcce7112b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:11.356908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec2ef-e462-442a-8a3d-e6bbcce7112b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:11.357024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec2ef-e462-442a-8a3d-e6bbcce7112b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:11.429097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-de2ec2ef-e462-442a-8a3d-e6bbcce7112b None None] MFA Rules not processed for user `6ec03fbc1019458b83bcc0af6fb04ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:11.430445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-de2ec2ef-e462-442a-8a3d-e6bbcce7112b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:11.529751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 672/1330] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:11.812835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a41d1-633d-4167-bd7a-ee1a16a6a4b1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:11.815318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-094a41d1-633d-4167-bd7a-ee1a16a6a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:11.855175 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:11.935316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a41d1-633d-4167-bd7a-ee1a16a6a4b1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:12.019715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc17a3-f96c-4a9d-a718-0f40f2758d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:12.020334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc17a3-f96c-4a9d-a718-0f40f2758d9a service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:12.020614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc17a3-f96c-4a9d-a718-0f40f2758d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:12.020872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc17a3-f96c-4a9d-a718-0f40f2758d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:12.022543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bddc17a3-f96c-4a9d-a718-0f40f2758d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:12.113335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:12.146361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc17a3-f96c-4a9d-a718-0f40f2758d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:12.147897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc17a3-f96c-4a9d-a718-0f40f2758d9a service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:12.167058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 659/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:14.316975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f8cf9-68d8-40ff-8565-224623840305 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:14.317557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f8cf9-68d8-40ff-8565-224623840305 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:14.317557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f8cf9-68d8-40ff-8565-224623840305 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:14.318923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 673/1332] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:14.325371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41f71-de02-4fd2-a82b-6c113fa10909 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:14.326111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41f71-de02-4fd2-a82b-6c113fa10909 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:14.326239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b41f71-de02-4fd2-a82b-6c113fa10909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:14.406798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-03b41f71-de02-4fd2-a82b-6c113fa10909 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:14.408004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-03b41f71-de02-4fd2-a82b-6c113fa10909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:14.520891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 660/1333] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:14.810124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f8cf9-68d8-40ff-8565-224623840305 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:14.811712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d01f8cf9-68d8-40ff-8565-224623840305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:14.884739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:14.924350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f8cf9-68d8-40ff-8565-224623840305 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:15.011896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be5e5f-25d6-48b3-bd21-ecd4560bf93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:15.012501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5e5f-25d6-48b3-bd21-ecd4560bf93d service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:15.012774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5e5f-25d6-48b3-bd21-ecd4560bf93d service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:15.013037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5e5f-25d6-48b3-bd21-ecd4560bf93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:15.014662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c4be5e5f-25d6-48b3-bd21-ecd4560bf93d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:15.128938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be5e5f-25d6-48b3-bd21-ecd4560bf93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:15.130409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be5e5f-25d6-48b3-bd21-ecd4560bf93d service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:15.141112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:15.152676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 674/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:17.138397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93dc96-5ab8-4110-a274-24c3f7cc146e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:17.138990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93dc96-5ab8-4110-a274-24c3f7cc146e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:17.138990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93dc96-5ab8-4110-a274-24c3f7cc146e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:17.140285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 661/1335] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:17.147535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae60e-7668-4604-a89b-be0622a1b944 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:17.148273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae60e-7668-4604-a89b-be0622a1b944 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:17.148446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae60e-7668-4604-a89b-be0622a1b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:17.221830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fb5ae60e-7668-4604-a89b-be0622a1b944 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:17.223116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fb5ae60e-7668-4604-a89b-be0622a1b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:17.338051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 675/1336] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:17.631134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93dc96-5ab8-4110-a274-24c3f7cc146e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:17.633382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9a93dc96-5ab8-4110-a274-24c3f7cc146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:17.680274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:17.748288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93dc96-5ab8-4110-a274-24c3f7cc146e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:17.827964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16335c-5402-4069-aa7a-0a5a539653f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:17.828573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16335c-5402-4069-aa7a-0a5a539653f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:17.828844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16335c-5402-4069-aa7a-0a5a539653f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:17.829108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16335c-5402-4069-aa7a-0a5a539653f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:17.830749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7f16335c-5402-4069-aa7a-0a5a539653f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:17.915946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:17.942492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16335c-5402-4069-aa7a-0a5a539653f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:17.943915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16335c-5402-4069-aa7a-0a5a539653f7 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:17.961888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 662/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:20.510068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b926-1032-4ac8-aaae-788473e472c4 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:20.510917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b926-1032-4ac8-aaae-788473e472c4 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:20.510917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6b926-1032-4ac8-aaae-788473e472c4 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:20.513138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 676/1338] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:20.522177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11334a9-00ab-4dea-b75b-2fa06a4acc17 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:20.522648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11334a9-00ab-4dea-b75b-2fa06a4acc17 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:20.523102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11334a9-00ab-4dea-b75b-2fa06a4acc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:20.607044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a11334a9-00ab-4dea-b75b-2fa06a4acc17 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:20.608328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a11334a9-00ab-4dea-b75b-2fa06a4acc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:20.731488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 663/1339] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:21.016659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6b926-1032-4ac8-aaae-788473e472c4 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:21.019574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b9d6b926-1032-4ac8-aaae-788473e472c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:21.115356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:21.145408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6b926-1032-4ac8-aaae-788473e472c4 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:21.227288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d959d4-199b-4fee-89a5-15b5eaff013e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:21.228121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d959d4-199b-4fee-89a5-15b5eaff013e service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:21.228501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d959d4-199b-4fee-89a5-15b5eaff013e service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:21.228796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d959d4-199b-4fee-89a5-15b5eaff013e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:21.231418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-78d959d4-199b-4fee-89a5-15b5eaff013e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:21.366534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d959d4-199b-4fee-89a5-15b5eaff013e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:21.367956 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d959d4-199b-4fee-89a5-15b5eaff013e service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:21.386463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 677/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:25.428537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea656f-ac56-490d-bf04-e1f7f5687a56 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:25.429047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea656f-ac56-490d-bf04-e1f7f5687a56 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:25.429047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea656f-ac56-490d-bf04-e1f7f5687a56 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:25.430396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 664/1341] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:25.435894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189e94-03fd-4960-a197-b2ece0d8bc06 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:25.436370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189e94-03fd-4960-a197-b2ece0d8bc06 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:25.436459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189e94-03fd-4960-a197-b2ece0d8bc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:25.445664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:25.514075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f4189e94-03fd-4960-a197-b2ece0d8bc06 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:25.515271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f4189e94-03fd-4960-a197-b2ece0d8bc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:25.633588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 678/1342] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:25.920318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea656f-ac56-490d-bf04-e1f7f5687a56 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:25.921924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-02ea656f-ac56-490d-bf04-e1f7f5687a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:25.975307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:26.037717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea656f-ac56-490d-bf04-e1f7f5687a56 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:26.127424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfbb7a-008e-4281-96e6-87ab44abb995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:26.128327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbb7a-008e-4281-96e6-87ab44abb995 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:26.128987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbb7a-008e-4281-96e6-87ab44abb995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:26.128987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbb7a-008e-4281-96e6-87ab44abb995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:26.130365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-82cfbb7a-008e-4281-96e6-87ab44abb995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:26.235683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:26.253563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfbb7a-008e-4281-96e6-87ab44abb995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:26.255173 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfbb7a-008e-4281-96e6-87ab44abb995 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:26.274811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 665/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:28.778708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a89-f4eb-4d51-aa22-14a9ab7e2b0c None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:28.779309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a89-f4eb-4d51-aa22-14a9ab7e2b0c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:28.779309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a89-f4eb-4d51-aa22-14a9ab7e2b0c None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:28.780609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 679/1344] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:28.786764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7277e2-d9cd-4d6c-b5c7-968c02d25b22 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:28.787292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7277e2-d9cd-4d6c-b5c7-968c02d25b22 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:28.787292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7277e2-d9cd-4d6c-b5c7-968c02d25b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:28.856269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8d7277e2-d9cd-4d6c-b5c7-968c02d25b22 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:28.857525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8d7277e2-d9cd-4d6c-b5c7-968c02d25b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:28.956786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 666/1345] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:29.241261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072a89-f4eb-4d51-aa22-14a9ab7e2b0c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:29.242829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-63072a89-f4eb-4d51-aa22-14a9ab7e2b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:29.333117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:29.352840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072a89-f4eb-4d51-aa22-14a9ab7e2b0c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:29.439954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425ffec-d378-4f9d-b814-5bbaa642e820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:29.440575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ffec-d378-4f9d-b814-5bbaa642e820 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:29.440851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ffec-d378-4f9d-b814-5bbaa642e820 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:29.441154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425ffec-d378-4f9d-b814-5bbaa642e820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:29.442787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4425ffec-d378-4f9d-b814-5bbaa642e820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:29.554311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425ffec-d378-4f9d-b814-5bbaa642e820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:29.555635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425ffec-d378-4f9d-b814-5bbaa642e820 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:29.574200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 680/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:33.795025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe496-a9dc-458b-9275-c1b4862003a4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:33.795570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe496-a9dc-458b-9275-c1b4862003a4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:33.795664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe496-a9dc-458b-9275-c1b4862003a4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:33.797612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 667/1347] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:33.803614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab17a-1613-40cc-ac5c-381e134f23b6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:33.804081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab17a-1613-40cc-ac5c-381e134f23b6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:33.804177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ab17a-1613-40cc-ac5c-381e134f23b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:33.820932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:33.876531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4a3ab17a-1613-40cc-ac5c-381e134f23b6 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:33.877888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4a3ab17a-1613-40cc-ac5c-381e134f23b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:33.978249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 681/1348] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:34.261962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fe496-a9dc-458b-9275-c1b4862003a4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:34.263584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-552fe496-a9dc-458b-9275-c1b4862003a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:34.323568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:34.374391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fe496-a9dc-458b-9275-c1b4862003a4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:34.452351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fa5ae-0352-4ea6-ba0f-ff433880ba2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:34.452968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fa5ae-0352-4ea6-ba0f-ff433880ba2f service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:34.453275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fa5ae-0352-4ea6-ba0f-ff433880ba2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:34.453542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fa5ae-0352-4ea6-ba0f-ff433880ba2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:34.455159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-768fa5ae-0352-4ea6-ba0f-ff433880ba2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:34.563956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:34.568140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fa5ae-0352-4ea6-ba0f-ff433880ba2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:34.569953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fa5ae-0352-4ea6-ba0f-ff433880ba2f service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:34.588425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 668/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:39.582282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b20b86-f45b-4f42-91ea-1803102224e4 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:39.582850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b20b86-f45b-4f42-91ea-1803102224e4 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:39.583123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b20b86-f45b-4f42-91ea-1803102224e4 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:39.584598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 682/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:39.596867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e686-f617-40de-a9d5-fb828d428cbd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:39.599686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e686-f617-40de-a9d5-fb828d428cbd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:39.600154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34e686-f617-40de-a9d5-fb828d428cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:39.691420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6c34e686-f617-40de-a9d5-fb828d428cbd None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:39.692916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6c34e686-f617-40de-a9d5-fb828d428cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:39.826685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 669/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:11:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:43.775505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73650-94b9-4efa-babc-89aa45eb80c9 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:43.776055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73650-94b9-4efa-babc-89aa45eb80c9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:43.776055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73650-94b9-4efa-babc-89aa45eb80c9 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:43.777742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 683/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:43.783067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c33c7-bec1-4f05-b55f-cb15f76da46b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:43.783492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c33c7-bec1-4f05-b55f-cb15f76da46b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:43.783573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c33c7-bec1-4f05-b55f-cb15f76da46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:43.839795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:43.873919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-529c33c7-bec1-4f05-b55f-cb15f76da46b None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:43.875137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-529c33c7-bec1-4f05-b55f-cb15f76da46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:43.976646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=59 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:43.997114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 670/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:11:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:11:45.355608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e881-1c05-4e2b-a669-86260bf8af1c None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:45.356127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e881-1c05-4e2b-a669-86260bf8af1c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:45.356127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5e881-1c05-4e2b-a669-86260bf8af1c None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:45.357536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 684/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:45.362901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475ced-fb32-45a6-a677-587a59d3711c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:45.363306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475ced-fb32-45a6-a677-587a59d3711c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:45.363567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31475ced-fb32-45a6-a677-587a59d3711c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:45.443897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-31475ced-fb32-45a6-a677-587a59d3711c None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:45.445173 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-31475ced-fb32-45a6-a677-587a59d3711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:45.488990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:45.556902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 671/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:11:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:48.920330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d69a5-cf3c-4581-a4ed-37fa9fd52d5c None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:48.920876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d69a5-cf3c-4581-a4ed-37fa9fd52d5c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:48.920876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d69a5-cf3c-4581-a4ed-37fa9fd52d5c None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:48.922172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 685/1356] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:48.927658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0010fe-7d77-40c7-be8e-db754351f036 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:48.928106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0010fe-7d77-40c7-be8e-db754351f036 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:48.928232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0010fe-7d77-40c7-be8e-db754351f036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:49.001313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5c0010fe-7d77-40c7-be8e-db754351f036 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:49.002533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c0010fe-7d77-40c7-be8e-db754351f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:49.132760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 672/1357] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:49.446481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b16d7-9e55-4fbb-a3ee-cd894d494efd None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:49.447663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b16d7-9e55-4fbb-a3ee-cd894d494efd None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:49.448235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b16d7-9e55-4fbb-a3ee-cd894d494efd None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:49.452406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 686/1358] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 31 05:11:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:49.461211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402f4c-076c-4842-8787-2f5f5f2da134 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:49.462031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402f4c-076c-4842-8787-2f5f5f2da134 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:49.462659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70402f4c-076c-4842-8787-2f5f5f2da134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:49.482387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:49.566002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-70402f4c-076c-4842-8787-2f5f5f2da134 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:49.567249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-70402f4c-076c-4842-8787-2f5f5f2da134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:49.700498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 673/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 31 05:11:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:11:49.708141 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b16d7-9e55-4fbb-a3ee-cd894d494efd None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:49.709690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-078b16d7-9e55-4fbb-a3ee-cd894d494efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:49.857878 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b16d7-9e55-4fbb-a3ee-cd894d494efd None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:49.938237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:49.981163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211269b-942a-4203-a8a2-e13c971535d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:49.982164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211269b-942a-4203-a8a2-e13c971535d4 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:49.982655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211269b-942a-4203-a8a2-e13c971535d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:49.983131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211269b-942a-4203-a8a2-e13c971535d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:49.984953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c211269b-942a-4203-a8a2-e13c971535d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:50.078961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211269b-942a-4203-a8a2-e13c971535d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:50.080565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211269b-942a-4203-a8a2-e13c971535d4 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:50.100214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 687/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:52.214973 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b205d0-54de-45cb-8a24-ffb0078962b8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:52.215542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b205d0-54de-45cb-8a24-ffb0078962b8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:52.215642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b205d0-54de-45cb-8a24-ffb0078962b8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:52.217160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 674/1361] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:52.222657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd03c-2f65-4ccc-9f79-aeb2cbf61928 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:52.223147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd03c-2f65-4ccc-9f79-aeb2cbf61928 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:52.223147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fd03c-2f65-4ccc-9f79-aeb2cbf61928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:52.292959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-986fd03c-2f65-4ccc-9f79-aeb2cbf61928 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:52.294178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-986fd03c-2f65-4ccc-9f79-aeb2cbf61928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:52.335316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:52.405079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 688/1362] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:52.692135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b205d0-54de-45cb-8a24-ffb0078962b8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:52.693657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e6b205d0-54de-45cb-8a24-ffb0078962b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:52.764613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:52.851512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b205d0-54de-45cb-8a24-ffb0078962b8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:52.982366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac83ca-0514-4e09-9eae-981a66badd26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:52.983005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac83ca-0514-4e09-9eae-981a66badd26 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:52.983249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac83ca-0514-4e09-9eae-981a66badd26 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:52.983516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac83ca-0514-4e09-9eae-981a66badd26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:52.985181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a8ac83ca-0514-4e09-9eae-981a66badd26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:53.010849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:53.081650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac83ca-0514-4e09-9eae-981a66badd26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:53.083275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac83ca-0514-4e09-9eae-981a66badd26 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:53.102443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 675/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:55.317032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceab4c-d21a-4ec3-8d8c-641ca20d7378 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:55.317622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceab4c-d21a-4ec3-8d8c-641ca20d7378 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:55.317622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceab4c-d21a-4ec3-8d8c-641ca20d7378 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:55.318941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 689/1364] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:55.324473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8a18-d8cf-428b-8a9a-182f26669d4b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:55.325328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8a18-d8cf-428b-8a9a-182f26669d4b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:55.325749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8a18-d8cf-428b-8a9a-182f26669d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:55.397469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-df1b8a18-d8cf-428b-8a9a-182f26669d4b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:55.398734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-df1b8a18-d8cf-428b-8a9a-182f26669d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:55.500873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:55.504238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 676/1365] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:11:55.792977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb76e-b2cb-4f5a-8f6d-b29f4eff7845 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:55.793554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb76e-b2cb-4f5a-8f6d-b29f4eff7845 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:55.793828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb76e-b2cb-4f5a-8f6d-b29f4eff7845 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:55.795154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 690/1366] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 31 05:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:55.801492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86040092-d3df-4b64-9660-609884c7f259 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:55.801879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86040092-d3df-4b64-9660-609884c7f259 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:55.802334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86040092-d3df-4b64-9660-609884c7f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:55.885759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-86040092-d3df-4b64-9660-609884c7f259 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:55.887043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-86040092-d3df-4b64-9660-609884c7f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:56.020393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 677/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 31 05:11:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:56.028509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb76e-b2cb-4f5a-8f6d-b29f4eff7845 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:56.030187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3d0eb76e-b2cb-4f5a-8f6d-b29f4eff7845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:56.191656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb76e-b2cb-4f5a-8f6d-b29f4eff7845 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:56.213205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:56.311888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c128-8c91-4dbd-b36e-4174a55b06fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:56.312499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c128-8c91-4dbd-b36e-4174a55b06fc service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:56.312786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c128-8c91-4dbd-b36e-4174a55b06fc service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:56.313037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c128-8c91-4dbd-b36e-4174a55b06fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:56.314715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2ec4c128-8c91-4dbd-b36e-4174a55b06fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:56.408156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c128-8c91-4dbd-b36e-4174a55b06fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:56.410095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c128-8c91-4dbd-b36e-4174a55b06fc service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:56.432238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 691/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:56.981377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a140518-7fee-411c-bd46-44203dd260ea None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:56.981956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a140518-7fee-411c-bd46-44203dd260ea None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:56.981956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a140518-7fee-411c-bd46-44203dd260ea None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:56.983481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 678/1369] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:56.989835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0da044-eb58-4bb7-8492-529201da5ae5 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:56.990152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0da044-eb58-4bb7-8492-529201da5ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:56.990390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0da044-eb58-4bb7-8492-529201da5ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:57.027475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:57.067614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7f0da044-eb58-4bb7-8492-529201da5ae5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:57.068898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7f0da044-eb58-4bb7-8492-529201da5ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:57.181155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 692/1370] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:57.784526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2f12a-c63d-41fb-991a-322cf44e94c2 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:57.784943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2f12a-c63d-41fb-991a-322cf44e94c2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:57.785319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2f12a-c63d-41fb-991a-322cf44e94c2 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:57.786955 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 679/1371] 10.222.0.17 () {54 vars in 964 bytes} [Wed Aug 31 05:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:57.792187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7783-4a83-412c-a127-12df958f5e86 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:57.792836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7783-4a83-412c-a127-12df958f5e86 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:57.792836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c7783-4a83-412c-a127-12df958f5e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:57.882214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-604c7783-4a83-412c-a127-12df958f5e86 None None] MFA Rules not processed for user `75e27abf26954289b3fcffa332e155a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:57.883420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-604c7783-4a83-412c-a127-12df958f5e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:57.936254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:57.977623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 693/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Aug 31 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:57.985912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2f12a-c63d-41fb-991a-322cf44e94c2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:57.987738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-51a2f12a-c63d-41fb-991a-322cf44e94c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:58.045166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:58.105016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2f12a-c63d-41fb-991a-322cf44e94c2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:58.190637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b90eb-aadc-4f08-8fa1-5b7233d0ef62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:58.191372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b90eb-aadc-4f08-8fa1-5b7233d0ef62 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:58.191870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b90eb-aadc-4f08-8fa1-5b7233d0ef62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:58.192257 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b90eb-aadc-4f08-8fa1-5b7233d0ef62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:58.193990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b31b90eb-aadc-4f08-8fa1-5b7233d0ef62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:58.325734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:58.343134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b90eb-aadc-4f08-8fa1-5b7233d0ef62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:58.344951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b90eb-aadc-4f08-8fa1-5b7233d0ef62 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:58.370521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 680/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:11:58.411790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1ebb-005d-4554-8443-05ce8d79c5a0 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:58.412082 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1ebb-005d-4554-8443-05ce8d79c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:58.412349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab1ebb-005d-4554-8443-05ce8d79c5a0 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:58.413770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 694/1374] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:11:58.419209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233de0-4bb7-4bd8-a21b-58f45b4d0218 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:58.419376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233de0-4bb7-4bd8-a21b-58f45b4d0218 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:58.419656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233de0-4bb7-4bd8-a21b-58f45b4d0218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:58.496977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b3233de0-4bb7-4bd8-a21b-58f45b4d0218 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:11:58.497938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b3233de0-4bb7-4bd8-a21b-58f45b4d0218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:58.604771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 681/1375] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:11:58.890337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab1ebb-005d-4554-8443-05ce8d79c5a0 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:11:58.891876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b3ab1ebb-005d-4554-8443-05ce8d79c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:59.045562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab1ebb-005d-4554-8443-05ce8d79c5a0 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:11:59.103994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:11:59.171292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a14d1e-15f0-4a55-b886-5b8a87e33195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:11:59.171908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a14d1e-15f0-4a55-b886-5b8a87e33195 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:11:59.172184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a14d1e-15f0-4a55-b886-5b8a87e33195 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:11:59.172475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a14d1e-15f0-4a55-b886-5b8a87e33195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:11:59.174117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a6a14d1e-15f0-4a55-b886-5b8a87e33195 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:11:59.269371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a14d1e-15f0-4a55-b886-5b8a87e33195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:11:59.270995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a14d1e-15f0-4a55-b886-5b8a87e33195 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:11:59.289249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 695/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:01.235404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65469d-c690-4921-aa36-b926ee893d3a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:01.235952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65469d-c690-4921-aa36-b926ee893d3a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:01.235952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb65469d-c690-4921-aa36-b926ee893d3a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:01.237282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 682/1377] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:01.242825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e796de-bdc7-4b50-a08d-06409c405a5d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:01.243297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e796de-bdc7-4b50-a08d-06409c405a5d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:01.243395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e796de-bdc7-4b50-a08d-06409c405a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:01.316056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-56e796de-bdc7-4b50-a08d-06409c405a5d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:01.317765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-56e796de-bdc7-4b50-a08d-06409c405a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:01.328136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:01.427433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 696/1378] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:01.718557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65469d-c690-4921-aa36-b926ee893d3a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:01.720228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fb65469d-c690-4921-aa36-b926ee893d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:01.782914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:01.871338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb65469d-c690-4921-aa36-b926ee893d3a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:02.013981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a3f68-94b8-4523-b6a7-2f3a4a57b8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:02.014680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a3f68-94b8-4523-b6a7-2f3a4a57b8a6 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:02.015049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a3f68-94b8-4523-b6a7-2f3a4a57b8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:02.015387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a3f68-94b8-4523-b6a7-2f3a4a57b8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:02.017145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-978a3f68-94b8-4523-b6a7-2f3a4a57b8a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:02.037206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:02.138027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a3f68-94b8-4523-b6a7-2f3a4a57b8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:02.139744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a3f68-94b8-4523-b6a7-2f3a4a57b8a6 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:02.163866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 683/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:04.131534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea9691-8810-4bcd-b219-70f91bc9bd16 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:04.132277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea9691-8810-4bcd-b219-70f91bc9bd16 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:04.132277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea9691-8810-4bcd-b219-70f91bc9bd16 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:04.133818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 697/1380] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:04.139700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff2ea1-3665-44b8-a94d-9412ff69b5f8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:04.140264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff2ea1-3665-44b8-a94d-9412ff69b5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:04.140264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff2ea1-3665-44b8-a94d-9412ff69b5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:04.216160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-54ff2ea1-3665-44b8-a94d-9412ff69b5f8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:04.217311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-54ff2ea1-3665-44b8-a94d-9412ff69b5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:04.313332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:04.321294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 684/1381] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:04.606089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea9691-8810-4bcd-b219-70f91bc9bd16 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:04.607962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fcea9691-8810-4bcd-b219-70f91bc9bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:04.763846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:04.775339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea9691-8810-4bcd-b219-70f91bc9bd16 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:04.903104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec03d9f-d0c8-4e92-8252-aba140e0b9e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:04.903654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03d9f-d0c8-4e92-8252-aba140e0b9e3 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:04.903936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03d9f-d0c8-4e92-8252-aba140e0b9e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:04.904204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec03d9f-d0c8-4e92-8252-aba140e0b9e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:04.906055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5ec03d9f-d0c8-4e92-8252-aba140e0b9e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:05.009978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec03d9f-d0c8-4e92-8252-aba140e0b9e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:05.011585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec03d9f-d0c8-4e92-8252-aba140e0b9e3 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:05.024545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:05.034131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 698/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:06.967768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f629ed3-1f29-4756-8995-39b63ad9bdc4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:06.968413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f629ed3-1f29-4756-8995-39b63ad9bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:06.968413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f629ed3-1f29-4756-8995-39b63ad9bdc4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:06.969594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 685/1383] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:06.975575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127cba-3816-4500-b1a2-dc3bc5d16ab7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:06.975996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127cba-3816-4500-b1a2-dc3bc5d16ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:06.976121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9127cba-3816-4500-b1a2-dc3bc5d16ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:07.048443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-c9127cba-3816-4500-b1a2-dc3bc5d16ab7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:07.049863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c9127cba-3816-4500-b1a2-dc3bc5d16ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:07.151483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 699/1384] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:07.437010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f629ed3-1f29-4756-8995-39b63ad9bdc4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:07.438558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6f629ed3-1f29-4756-8995-39b63ad9bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:07.615773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f629ed3-1f29-4756-8995-39b63ad9bdc4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:07.700143 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:07.765825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cea114-9445-438f-9ebc-782b0df44006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:07.766837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea114-9445-438f-9ebc-782b0df44006 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:07.767183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea114-9445-438f-9ebc-782b0df44006 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:07.767528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea114-9445-438f-9ebc-782b0df44006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:07.770325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a6cea114-9445-438f-9ebc-782b0df44006 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:07.869688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cea114-9445-438f-9ebc-782b0df44006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:07.871307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cea114-9445-438f-9ebc-782b0df44006 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:07.889633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 686/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:09.787618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78e4f-298b-43de-b292-53b7a9d8010e None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:09.788195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78e4f-298b-43de-b292-53b7a9d8010e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:09.788195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d78e4f-298b-43de-b292-53b7a9d8010e None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:09.789478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 700/1386] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:09.800047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e899c4-c517-44c2-a36a-f751d1c2e3a5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:09.801427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e899c4-c517-44c2-a36a-f751d1c2e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:09.801427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e899c4-c517-44c2-a36a-f751d1c2e3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:09.886597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-85e899c4-c517-44c2-a36a-f751d1c2e3a5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:09.887878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-85e899c4-c517-44c2-a36a-f751d1c2e3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:09.930648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:10.025741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 687/1387] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:12:10.407775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d78e4f-298b-43de-b292-53b7a9d8010e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:10.410101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-81d78e4f-298b-43de-b292-53b7a9d8010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:10.521059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:10.636940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d78e4f-298b-43de-b292-53b7a9d8010e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:10.768656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67185aa9-c353-424e-9480-e5912935dc11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:10.769565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185aa9-c353-424e-9480-e5912935dc11 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:10.769782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185aa9-c353-424e-9480-e5912935dc11 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:10.770048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67185aa9-c353-424e-9480-e5912935dc11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:10.771678 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-67185aa9-c353-424e-9480-e5912935dc11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:10.814383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:10.869143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67185aa9-c353-424e-9480-e5912935dc11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:10.870760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67185aa9-c353-424e-9480-e5912935dc11 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:10.890736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 701/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:12.898363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d7181-65c3-4524-81bb-a95e35768491 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:12.898929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d7181-65c3-4524-81bb-a95e35768491 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:12.898929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d7181-65c3-4524-81bb-a95e35768491 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:12.900148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 688/1389] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:12.905523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e9756-a973-4110-830c-f7e70254101d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:12.905986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e9756-a973-4110-830c-f7e70254101d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:12.906116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e9756-a973-4110-830c-f7e70254101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:12.976008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-151e9756-a973-4110-830c-f7e70254101d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:12.977250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-151e9756-a973-4110-830c-f7e70254101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:13.089365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 702/1390] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:13.373900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d7181-65c3-4524-81bb-a95e35768491 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:13.375485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-791d7181-65c3-4524-81bb-a95e35768491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:13.494850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975244f-d555-4e87-8e43-275f59a86568 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:13.495103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975244f-d555-4e87-8e43-275f59a86568 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:13.495388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975244f-d555-4e87-8e43-275f59a86568 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:13.497114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 703/1391] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:12:13.501744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703531-9191-4676-9e60-0ec6a645a4bd None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:13.502026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703531-9191-4676-9e60-0ec6a645a4bd None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:13.502295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0703531-9191-4676-9e60-0ec6a645a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:13.518143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:13.528133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d7181-65c3-4524-81bb-a95e35768491 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:13.545389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:13.573570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b0703531-9191-4676-9e60-0ec6a645a4bd None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:13.574789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b0703531-9191-4676-9e60-0ec6a645a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:13.648208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfb2cf-52d4-413c-8edc-5b1494b697ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:13.648826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb2cf-52d4-413c-8edc-5b1494b697ab service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:13.649123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb2cf-52d4-413c-8edc-5b1494b697ab service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:13.649390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfb2cf-52d4-413c-8edc-5b1494b697ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:13.650996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f6dfb2cf-52d4-413c-8edc-5b1494b697ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:13.678055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 704/1392] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:12:13.741879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb2cf-52d4-413c-8edc-5b1494b697ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:13.743543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfb2cf-52d4-413c-8edc-5b1494b697ab service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:13.761500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 689/1393] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:13.988126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087370f-ad37-478e-9cdd-7f83463fd357 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:13.988624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087370f-ad37-478e-9cdd-7f83463fd357 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:13.988624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087370f-ad37-478e-9cdd-7f83463fd357 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:13.990056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 705/1394] 10.222.0.17 () {54 vars in 967 bytes} [Wed Aug 31 05:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:13.995383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e6fb-87ba-4fe2-b505-b061388ef064 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:13.995859 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e6fb-87ba-4fe2-b505-b061388ef064 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:13.995970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5e6fb-87ba-4fe2-b505-b061388ef064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:14.022487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:14.076857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fae5e6fb-87ba-4fe2-b505-b061388ef064 None None] MFA Rules not processed for user `24f45db0ea864a3299cccd7a74b7271b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:14.078119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fae5e6fb-87ba-4fe2-b505-b061388ef064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:14.158664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 690/1395] 10.222.0.17 () {58 vars in 1064 bytes} [Wed Aug 31 05:12:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:14.167202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087370f-ad37-478e-9cdd-7f83463fd357 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:14.168833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0087370f-ad37-478e-9cdd-7f83463fd357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:14.274728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:14.282607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087370f-ad37-478e-9cdd-7f83463fd357 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:14.357561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262d9f2-132d-4cf7-90a1-204980b50175 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f45db0ea864a3299cccd7a74b7271b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:14.358159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d9f2-132d-4cf7-90a1-204980b50175 service glance] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:14.358432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d9f2-132d-4cf7-90a1-204980b50175 service glance] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:14.358696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262d9f2-132d-4cf7-90a1-204980b50175 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:14.360285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1262d9f2-132d-4cf7-90a1-204980b50175 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:14.470973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262d9f2-132d-4cf7-90a1-204980b50175 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:14.472451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262d9f2-132d-4cf7-90a1-204980b50175 service glance] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:14.491570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 706/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:15.235636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a039e-164b-4eff-8fc7-a54ac74d6c6d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:15.236127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a039e-164b-4eff-8fc7-a54ac74d6c6d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:15.236127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a039e-164b-4eff-8fc7-a54ac74d6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:15.303192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5b7a039e-164b-4eff-8fc7-a54ac74d6c6d None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:15.304412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5b7a039e-164b-4eff-8fc7-a54ac74d6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:15.367223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:15.396455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 691/1397] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:12:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:15.443658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84b18-3929-4e8e-a30d-10572298e8d8 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:15.444119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84b18-3929-4e8e-a30d-10572298e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:15.444317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc84b18-3929-4e8e-a30d-10572298e8d8 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:15.445915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 707/1398] 10.222.0.17 () {54 vars in 943 bytes} [Wed Aug 31 05:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:15.452422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476596d-182c-47d6-b9f9-e5149eebe371 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:15.452704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476596d-182c-47d6-b9f9-e5149eebe371 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:15.452973 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476596d-182c-47d6-b9f9-e5149eebe371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:15.533945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f476596d-182c-47d6-b9f9-e5149eebe371 None None] MFA Rules not processed for user `2a9e63804d3340b09aa7a3b0e7e8f2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:15.535188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f476596d-182c-47d6-b9f9-e5149eebe371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:15.651071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 692/1399] 10.222.0.17 () {58 vars in 1040 bytes} [Wed Aug 31 05:12:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:15.660586 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc84b18-3929-4e8e-a30d-10572298e8d8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:15.662168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5dc84b18-3929-4e8e-a30d-10572298e8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:15.685708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:15.695543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940bb2-c149-479d-ba0e-a0ecf6ac40ab None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:15.695843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940bb2-c149-479d-ba0e-a0ecf6ac40ab None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:15.696133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56940bb2-c149-479d-ba0e-a0ecf6ac40ab None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:15.697555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 693/1400] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:12:15.702560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9534fb-9fa5-4c7a-ba92-d3c2234295db None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:15.702818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9534fb-9fa5-4c7a-ba92-d3c2234295db None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:15.703124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9534fb-9fa5-4c7a-ba92-d3c2234295db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:15.749527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:15.772074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2d9534fb-9fa5-4c7a-ba92-d3c2234295db None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:15.773348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2d9534fb-9fa5-4c7a-ba92-d3c2234295db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:15.806790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc84b18-3929-4e8e-a30d-10572298e8d8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:15.871978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 694/1401] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:12:15.913978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f10403-d9b0-4b4b-b5a8-93e4f592b2c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:15.914595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f10403-d9b0-4b4b-b5a8-93e4f592b2c4 service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:15.914845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f10403-d9b0-4b4b-b5a8-93e4f592b2c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:15.915144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f10403-d9b0-4b4b-b5a8-93e4f592b2c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:15.916789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-09f10403-d9b0-4b4b-b5a8-93e4f592b2c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:15.924129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:16.000843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f10403-d9b0-4b4b-b5a8-93e4f592b2c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:16.002465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f10403-d9b0-4b4b-b5a8-93e4f592b2c4 service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:16.010847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 708/1402] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:12:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:12:16.160280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9534fb-9fa5-4c7a-ba92-d3c2234295db None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:16.161638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2d9534fb-9fa5-4c7a-ba92-d3c2234295db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:16.294450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9534fb-9fa5-4c7a-ba92-d3c2234295db None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:16.298663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:16.422003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e5f16-4df6-4402-9f69-2c486984ba2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:16.422561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e5f16-4df6-4402-9f69-2c486984ba2f service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:16.422830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e5f16-4df6-4402-9f69-2c486984ba2f service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:16.423160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e5f16-4df6-4402-9f69-2c486984ba2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:16.424894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-600e5f16-4df6-4402-9f69-2c486984ba2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:16.528110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e5f16-4df6-4402-9f69-2c486984ba2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:16.529821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e5f16-4df6-4402-9f69-2c486984ba2f service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:16.549638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 695/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:18.515395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b799-056c-4b67-8307-e6c62127c300 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:18.516509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b799-056c-4b67-8307-e6c62127c300 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:18.516848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9b799-056c-4b67-8307-e6c62127c300 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:18.518691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 709/1404] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:18.525644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd869c-6863-4070-aba1-b0dd2514da35 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:18.526119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd869c-6863-4070-aba1-b0dd2514da35 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:18.526212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd869c-6863-4070-aba1-b0dd2514da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:18.538624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:18.602263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5efd869c-6863-4070-aba1-b0dd2514da35 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:18.603489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5efd869c-6863-4070-aba1-b0dd2514da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:18.714416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 696/1405] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:19.013386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9b799-056c-4b67-8307-e6c62127c300 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:19.014915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-38e9b799-056c-4b67-8307-e6c62127c300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:19.180201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9b799-056c-4b67-8307-e6c62127c300 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:19.183341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:19.311738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b2e7e-826e-46a0-a242-66b3cf000b4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:19.312256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b2e7e-826e-46a0-a242-66b3cf000b4f service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:19.312535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b2e7e-826e-46a0-a242-66b3cf000b4f service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:19.312798 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b2e7e-826e-46a0-a242-66b3cf000b4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:19.314508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-003b2e7e-826e-46a0-a242-66b3cf000b4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:19.428335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b2e7e-826e-46a0-a242-66b3cf000b4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:19.430103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b2e7e-826e-46a0-a242-66b3cf000b4f service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:19.454727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 710/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:21.424984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ada7-30f9-47d3-a1ce-2d0df7fbdb64 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:21.425588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ada7-30f9-47d3-a1ce-2d0df7fbdb64 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:21.425588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ada7-30f9-47d3-a1ce-2d0df7fbdb64 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:21.426924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 697/1407] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:21.432132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443167cd-f564-4848-b116-d580a000caf1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:21.432597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443167cd-f564-4848-b116-d580a000caf1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:21.432703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443167cd-f564-4848-b116-d580a000caf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:21.442608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:21.502300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-443167cd-f564-4848-b116-d580a000caf1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:21.503746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-443167cd-f564-4848-b116-d580a000caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:21.611568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 711/1408] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:12:21.898711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717ada7-30f9-47d3-a1ce-2d0df7fbdb64 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:21.900387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1717ada7-30f9-47d3-a1ce-2d0df7fbdb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:22.002283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:22.071188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717ada7-30f9-47d3-a1ce-2d0df7fbdb64 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:22.195950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad5cda-bb43-442f-8765-e91c3ab405c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:22.196488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5cda-bb43-442f-8765-e91c3ab405c6 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:22.196776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5cda-bb43-442f-8765-e91c3ab405c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:22.197047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5cda-bb43-442f-8765-e91c3ab405c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:22.198698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a0ad5cda-bb43-442f-8765-e91c3ab405c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:22.254835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:22.295944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5cda-bb43-442f-8765-e91c3ab405c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:22.297598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5cda-bb43-442f-8765-e91c3ab405c6 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:22.317213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 698/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:31.609765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=62 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:32.314534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=23 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:37.779631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35d57-44bd-49c8-bcd9-9e3adcf50ade None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:37.780198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35d57-44bd-49c8-bcd9-9e3adcf50ade None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:37.780198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35d57-44bd-49c8-bcd9-9e3adcf50ade None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:37.781546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 712/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Aug 31 05:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:37.787249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd5cd-95d4-4946-abad-3575da542ceb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:37.787699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd5cd-95d4-4946-abad-3575da542ceb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:37.787812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd5cd-95d4-4946-abad-3575da542ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:37.869701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-760fd5cd-95d4-4946-abad-3575da542ceb None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:37.870946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-760fd5cd-95d4-4946-abad-3575da542ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:37.988283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 699/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 31 05:12:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:38.003343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9a16b-0cef-4a50-b4b8-2e2286aa74e3 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:38.003693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9a16b-0cef-4a50-b4b8-2e2286aa74e3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:38.004049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9a16b-0cef-4a50-b4b8-2e2286aa74e3 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:38.006145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 713/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Aug 31 05:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:38.014063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07ed56-2689-41d0-8f2c-6ff9e6e68a69 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:38.014386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07ed56-2689-41d0-8f2c-6ff9e6e68a69 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:38.014722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07ed56-2689-41d0-8f2c-6ff9e6e68a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:38.092249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:38.095576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-aa07ed56-2689-41d0-8f2c-6ff9e6e68a69 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:38.097423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aa07ed56-2689-41d0-8f2c-6ff9e6e68a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:38.217852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 700/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 31 05:12:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:40.655645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd7e1-3044-4789-86d6-8a82141146e6 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:40.656116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd7e1-3044-4789-86d6-8a82141146e6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:40.656212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd7e1-3044-4789-86d6-8a82141146e6 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:40.658375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:40.664149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec53ff-1fb1-4613-9746-a102b18cc8f9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:40.664608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec53ff-1fb1-4613-9746-a102b18cc8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:40.664720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec53ff-1fb1-4613-9746-a102b18cc8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:40.741300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5aec53ff-1fb1-4613-9746-a102b18cc8f9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:40.742541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5aec53ff-1fb1-4613-9746-a102b18cc8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:40.800574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:40.846598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:41.135734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd7e1-3044-4789-86d6-8a82141146e6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:41.137408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-16ffd7e1-3044-4789-86d6-8a82141146e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:41.301620 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd7e1-3044-4789-86d6-8a82141146e6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:41.385686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:41.428962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbce353-82fa-47c4-9bb9-3ff1c25b34ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:41.429590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce353-82fa-47c4-9bb9-3ff1c25b34ea service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:41.429861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce353-82fa-47c4-9bb9-3ff1c25b34ea service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:41.430122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbce353-82fa-47c4-9bb9-3ff1c25b34ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:41.431747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3fbce353-82fa-47c4-9bb9-3ff1c25b34ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:41.524873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbce353-82fa-47c4-9bb9-3ff1c25b34ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:41.526521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbce353-82fa-47c4-9bb9-3ff1c25b34ea service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:41.545022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 715/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:42.441679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68e2c-e914-4e54-959f-71846e4ddd0f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:42.442502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68e2c-e914-4e54-959f-71846e4ddd0f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:42.442502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef68e2c-e914-4e54-959f-71846e4ddd0f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:42.444457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:12:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:42.451465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0990543-89ad-4144-9e38-f50a82c16c92 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:42.451917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0990543-89ad-4144-9e38-f50a82c16c92 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:42.452032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0990543-89ad-4144-9e38-f50a82c16c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:42.531670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-c0990543-89ad-4144-9e38-f50a82c16c92 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:42.532894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c0990543-89ad-4144-9e38-f50a82c16c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:42.561679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:42.635786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:42.787652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef68e2c-e914-4e54-959f-71846e4ddd0f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:42.789123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9ef68e2c-e914-4e54-959f-71846e4ddd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:42.951074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef68e2c-e914-4e54-959f-71846e4ddd0f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:42.993323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:43.073618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a00a58-5f56-42e5-ae4e-5d158cde7920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:43.074210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00a58-5f56-42e5-ae4e-5d158cde7920 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:43.074510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00a58-5f56-42e5-ae4e-5d158cde7920 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:43.074756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00a58-5f56-42e5-ae4e-5d158cde7920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:43.076397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-10a00a58-5f56-42e5-ae4e-5d158cde7920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:43.179150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a00a58-5f56-42e5-ae4e-5d158cde7920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:43.180756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a00a58-5f56-42e5-ae4e-5d158cde7920 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:43.199240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 703/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:44.083990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980421-1211-43ea-8e22-029494628123 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:44.084820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980421-1211-43ea-8e22-029494628123 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:44.084972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe980421-1211-43ea-8e22-029494628123 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:44.087101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:12:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:44.095596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e768a10-95b2-42fe-8fd1-a97ae17d44b3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:44.096151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e768a10-95b2-42fe-8fd1-a97ae17d44b3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:44.096431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e768a10-95b2-42fe-8fd1-a97ae17d44b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:44.154265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:44.177123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5e768a10-95b2-42fe-8fd1-a97ae17d44b3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:44.178607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5e768a10-95b2-42fe-8fd1-a97ae17d44b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:44.295638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:44.446107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980421-1211-43ea-8e22-029494628123 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:44.448630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fe980421-1211-43ea-8e22-029494628123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:44.613177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe980421-1211-43ea-8e22-029494628123 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:44.627012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:44.735794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81379d98-eae8-4dd5-8e2f-bb9d834def08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:44.736456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81379d98-eae8-4dd5-8e2f-bb9d834def08 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:44.736768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81379d98-eae8-4dd5-8e2f-bb9d834def08 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:44.737016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81379d98-eae8-4dd5-8e2f-bb9d834def08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:44.738688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-81379d98-eae8-4dd5-8e2f-bb9d834def08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:44.833801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81379d98-eae8-4dd5-8e2f-bb9d834def08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:44.835439 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81379d98-eae8-4dd5-8e2f-bb9d834def08 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:44.853949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 718/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:45.725772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f734e-5724-4491-8f33-3e30c3bc9ebc None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:45.726358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f734e-5724-4491-8f33-3e30c3bc9ebc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:45.726358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f734e-5724-4491-8f33-3e30c3bc9ebc None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:45.728315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:45.736123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83662d-eba2-471a-8974-3f65f5b1993c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:45.736580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83662d-eba2-471a-8974-3f65f5b1993c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:45.737028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83662d-eba2-471a-8974-3f65f5b1993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:45.763639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:45.827592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-6b83662d-eba2-471a-8974-3f65f5b1993c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:45.828800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6b83662d-eba2-471a-8974-3f65f5b1993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:45.935284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:46.091910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f734e-5724-4491-8f33-3e30c3bc9ebc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:46.093529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-500f734e-5724-4491-8f33-3e30c3bc9ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:46.223754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:46.261226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f734e-5724-4491-8f33-3e30c3bc9ebc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:46.385202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a241925-59f2-4cd4-ad92-26630e5c7c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:46.385809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241925-59f2-4cd4-ad92-26630e5c7c98 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:46.386079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241925-59f2-4cd4-ad92-26630e5c7c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:46.386342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a241925-59f2-4cd4-ad92-26630e5c7c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:46.387954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7a241925-59f2-4cd4-ad92-26630e5c7c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:46.466259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:46.481507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241925-59f2-4cd4-ad92-26630e5c7c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:46.483017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a241925-59f2-4cd4-ad92-26630e5c7c98 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:46.501777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 706/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:47.373614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee05f4-d14c-485f-be74-16a570de6685 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:47.374187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee05f4-d14c-485f-be74-16a570de6685 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:47.374187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee05f4-d14c-485f-be74-16a570de6685 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:47.376248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:12:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:47.382936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4cd2-a4b2-4c15-89aa-19c5d7228cb0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:47.383342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4cd2-a4b2-4c15-89aa-19c5d7228cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:47.383518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4cd2-a4b2-4c15-89aa-19c5d7228cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:47.469289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-151a4cd2-a4b2-4c15-89aa-19c5d7228cb0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:47.470506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-151a4cd2-a4b2-4c15-89aa-19c5d7228cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:47.572394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:47.728871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee05f4-d14c-485f-be74-16a570de6685 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:47.730425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-adee05f4-d14c-485f-be74-16a570de6685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:47.834520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:47.907351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee05f4-d14c-485f-be74-16a570de6685 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:48.028053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9e027-7099-42f0-aaa6-bafeb5481a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:48.028654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e027-7099-42f0-aaa6-bafeb5481a3c service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:48.028924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e027-7099-42f0-aaa6-bafeb5481a3c service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:48.029214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e027-7099-42f0-aaa6-bafeb5481a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:48.030833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-14b9e027-7099-42f0-aaa6-bafeb5481a3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:48.080713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:48.122797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9e027-7099-42f0-aaa6-bafeb5481a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:48.124369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9e027-7099-42f0-aaa6-bafeb5481a3c service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:48.142436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 721/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:48.951901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c963a-8477-44d0-9dab-d90827c53bf7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:48.952775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c963a-8477-44d0-9dab-d90827c53bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:48.952775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c963a-8477-44d0-9dab-d90827c53bf7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:48.954913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:12:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:48.959991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bed2-d319-4703-b7bc-fa9fe3791498 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:48.960446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bed2-d319-4703-b7bc-fa9fe3791498 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:48.960549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4bed2-d319-4703-b7bc-fa9fe3791498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:49.037666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-07e4bed2-d319-4703-b7bc-fa9fe3791498 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:49.038861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-07e4bed2-d319-4703-b7bc-fa9fe3791498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:49.146078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:49.321709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c963a-8477-44d0-9dab-d90827c53bf7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:49.323232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f07c963a-8477-44d0-9dab-d90827c53bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:49.375346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:49.483836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c963a-8477-44d0-9dab-d90827c53bf7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:49.605343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59454867-166e-4800-8953-97dbf6566aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:49.606014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454867-166e-4800-8953-97dbf6566aba service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:49.606360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454867-166e-4800-8953-97dbf6566aba service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:49.606695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454867-166e-4800-8953-97dbf6566aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:49.609224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-59454867-166e-4800-8953-97dbf6566aba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:49.619071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:49.708893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59454867-166e-4800-8953-97dbf6566aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:49.710551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59454867-166e-4800-8953-97dbf6566aba service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:49.729182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 709/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:50.533676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b8ec-56c7-41eb-b5e5-2fdb2cd52a32 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:50.534596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b8ec-56c7-41eb-b5e5-2fdb2cd52a32 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:50.534767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69b8ec-56c7-41eb-b5e5-2fdb2cd52a32 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:50.536828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:12:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:50.545134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18747d-0234-4413-9e36-4dc25db67ddf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:50.545564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18747d-0234-4413-9e36-4dc25db67ddf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:50.545666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18747d-0234-4413-9e36-4dc25db67ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:50.628823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4a18747d-0234-4413-9e36-4dc25db67ddf None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:50.630100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4a18747d-0234-4413-9e36-4dc25db67ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:50.708560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:50.740349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:50.891954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69b8ec-56c7-41eb-b5e5-2fdb2cd52a32 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:50.893582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3c69b8ec-56c7-41eb-b5e5-2fdb2cd52a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:50.915485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:51.062883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69b8ec-56c7-41eb-b5e5-2fdb2cd52a32 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:51.153571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:51.181793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaf1b5-d63c-462d-bba2-b76dbfa2dabe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:51.182401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaf1b5-d63c-462d-bba2-b76dbfa2dabe service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:51.182674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaf1b5-d63c-462d-bba2-b76dbfa2dabe service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:51.182939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaf1b5-d63c-462d-bba2-b76dbfa2dabe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:51.184539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-dfbaf1b5-d63c-462d-bba2-b76dbfa2dabe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:51.277131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbaf1b5-d63c-462d-bba2-b76dbfa2dabe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:51.278745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbaf1b5-d63c-462d-bba2-b76dbfa2dabe service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:51.298059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 724/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:52.096052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77d569-7300-4f6e-89fe-a229e57b560c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:52.096584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77d569-7300-4f6e-89fe-a229e57b560c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:52.096584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77d569-7300-4f6e-89fe-a229e57b560c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:52.098127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:52.104283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77540d6-2507-4538-9c1a-f5ebbd901c5e None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:52.105023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77540d6-2507-4538-9c1a-f5ebbd901c5e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:52.105269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77540d6-2507-4538-9c1a-f5ebbd901c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:52.188485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a77540d6-2507-4538-9c1a-f5ebbd901c5e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:52.190289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a77540d6-2507-4538-9c1a-f5ebbd901c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:52.241134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:52.306660 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:52.457954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77d569-7300-4f6e-89fe-a229e57b560c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:52.459390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8e77d569-7300-4f6e-89fe-a229e57b560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:52.613249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77d569-7300-4f6e-89fe-a229e57b560c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:52.669589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:52.730472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73ccc6-3519-49e1-83d2-83fb77d6ad47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:52.731001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ccc6-3519-49e1-83d2-83fb77d6ad47 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:52.731273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ccc6-3519-49e1-83d2-83fb77d6ad47 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:52.731537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73ccc6-3519-49e1-83d2-83fb77d6ad47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:52.733120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fe73ccc6-3519-49e1-83d2-83fb77d6ad47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:52.835053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ccc6-3519-49e1-83d2-83fb77d6ad47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:52.836679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73ccc6-3519-49e1-83d2-83fb77d6ad47 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:52.855713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 712/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:53.671630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb45a1-46ae-4d03-9f0f-c5181d61a9ca None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:53.672123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb45a1-46ae-4d03-9f0f-c5181d61a9ca None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:53.672123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb45a1-46ae-4d03-9f0f-c5181d61a9ca None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:53.673554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:53.679785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac20dde-a5c1-42de-beb6-7108f7bd973a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:53.680538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac20dde-a5c1-42de-beb6-7108f7bd973a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:53.680672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac20dde-a5c1-42de-beb6-7108f7bd973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:53.768125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0ac20dde-a5c1-42de-beb6-7108f7bd973a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:53.769343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ac20dde-a5c1-42de-beb6-7108f7bd973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:53.771742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:53.881456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:54.041481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb45a1-46ae-4d03-9f0f-c5181d61a9ca None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:54.043016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c4eb45a1-46ae-4d03-9f0f-c5181d61a9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:54.198031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb45a1-46ae-4d03-9f0f-c5181d61a9ca None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:54.225241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:54.323126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58316af-d594-4a43-a590-b83032f82592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:54.323952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58316af-d594-4a43-a590-b83032f82592 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:54.324215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58316af-d594-4a43-a590-b83032f82592 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:54.324548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58316af-d594-4a43-a590-b83032f82592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:54.326682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e58316af-d594-4a43-a590-b83032f82592 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:54.436689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58316af-d594-4a43-a590-b83032f82592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:54.438320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58316af-d594-4a43-a590-b83032f82592 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:54.457027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 727/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:56.240686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18a69-e34e-41f8-8ff5-954122feeb85 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:56.241314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18a69-e34e-41f8-8ff5-954122feeb85 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:56.241314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb18a69-e34e-41f8-8ff5-954122feeb85 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:56.242605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:56.249318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82d56-c302-4d2a-a047-234109b02d73 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:56.250095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82d56-c302-4d2a-a047-234109b02d73 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:56.250247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c82d56-c302-4d2a-a047-234109b02d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:56.293933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:56.328739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-63c82d56-c302-4d2a-a047-234109b02d73 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:56.330027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-63c82d56-c302-4d2a-a047-234109b02d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:56.440932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:56.718903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18a69-e34e-41f8-8ff5-954122feeb85 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:56.721531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fbb18a69-e34e-41f8-8ff5-954122feeb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:56.845842 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb18a69-e34e-41f8-8ff5-954122feeb85 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:56.879366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:56.931061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8e285-67af-4784-91cc-58a5d2f0054b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:56.931672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8e285-67af-4784-91cc-58a5d2f0054b service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:56.931945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8e285-67af-4784-91cc-58a5d2f0054b service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:56.932213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8e285-67af-4784-91cc-58a5d2f0054b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:56.933851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-00b8e285-67af-4784-91cc-58a5d2f0054b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:57.061784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8e285-67af-4784-91cc-58a5d2f0054b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:57.063249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8e285-67af-4784-91cc-58a5d2f0054b service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:57.082421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 715/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:12:59.142459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf191e5a-51bb-4eb4-811e-2ad015741dfd None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:59.143065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf191e5a-51bb-4eb4-811e-2ad015741dfd None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:59.143065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf191e5a-51bb-4eb4-811e-2ad015741dfd None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:59.144561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:12:59.151296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541418d-7dff-4fc6-8519-68ad6838969a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:59.152035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541418d-7dff-4fc6-8519-68ad6838969a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:59.152293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541418d-7dff-4fc6-8519-68ad6838969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:59.227117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c541418d-7dff-4fc6-8519-68ad6838969a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:12:59.228315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c541418d-7dff-4fc6-8519-68ad6838969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:59.241258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:59.335611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:12:59.622621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf191e5a-51bb-4eb4-811e-2ad015741dfd None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:12:59.624205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-cf191e5a-51bb-4eb4-811e-2ad015741dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:59.733464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf191e5a-51bb-4eb4-811e-2ad015741dfd None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:12:59.746937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:12:59.820512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b883b9d-90eb-41cf-8ef8-e5a743c06810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:12:59.821119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883b9d-90eb-41cf-8ef8-e5a743c06810 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:12:59.821425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883b9d-90eb-41cf-8ef8-e5a743c06810 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:12:59.821690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883b9d-90eb-41cf-8ef8-e5a743c06810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:12:59.823306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7b883b9d-90eb-41cf-8ef8-e5a743c06810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:12:59.938658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b883b9d-90eb-41cf-8ef8-e5a743c06810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:12:59.940183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b883b9d-90eb-41cf-8ef8-e5a743c06810 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:12:59.958884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 730/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:02.194174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d18c50-c657-4bd2-9374-b2781a0caa54 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:02.195053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d18c50-c657-4bd2-9374-b2781a0caa54 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:02.195053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d18c50-c657-4bd2-9374-b2781a0caa54 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:02.197314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:02.206078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004fd9-8955-4bd8-964e-82e42bea5ca7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:02.206532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004fd9-8955-4bd8-964e-82e42bea5ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:02.206896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004fd9-8955-4bd8-964e-82e42bea5ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:02.278764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:02.299357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-32004fd9-8955-4bd8-964e-82e42bea5ca7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:02.300527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-32004fd9-8955-4bd8-964e-82e42bea5ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:02.409574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:02.692484 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d18c50-c657-4bd2-9374-b2781a0caa54 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:02.695157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-61d18c50-c657-4bd2-9374-b2781a0caa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:02.809073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d18c50-c657-4bd2-9374-b2781a0caa54 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:02.852959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:02.887933 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a19fa1-402c-46f5-9966-ff4cda1a2794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:02.888471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19fa1-402c-46f5-9966-ff4cda1a2794 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:02.888751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19fa1-402c-46f5-9966-ff4cda1a2794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:02.889022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a19fa1-402c-46f5-9966-ff4cda1a2794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:02.890678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b5a19fa1-402c-46f5-9966-ff4cda1a2794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:03.006316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a19fa1-402c-46f5-9966-ff4cda1a2794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:03.007757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a19fa1-402c-46f5-9966-ff4cda1a2794 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:03.026633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 718/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:05.023197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a40f2-4d2f-4f87-848e-cfbaac44c012 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:05.024039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a40f2-4d2f-4f87-848e-cfbaac44c012 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:05.024039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a40f2-4d2f-4f87-848e-cfbaac44c012 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:05.026184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:05.032524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e6d5-bba5-4b02-a040-741d8f6fcdfd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:05.033267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e6d5-bba5-4b02-a040-741d8f6fcdfd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:05.033421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e6d5-bba5-4b02-a040-741d8f6fcdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:05.108132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e7b9e6d5-bba5-4b02-a040-741d8f6fcdfd None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:05.109391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e7b9e6d5-bba5-4b02-a040-741d8f6fcdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:05.131451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:05.212411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:05.498422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a40f2-4d2f-4f87-848e-cfbaac44c012 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:05.501243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8f7a40f2-4d2f-4f87-848e-cfbaac44c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:05.625816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a40f2-4d2f-4f87-848e-cfbaac44c012 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:05.649026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:05.705129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f65bc-e9fc-4122-ad38-f7ca13e0ab44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:05.705824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f65bc-e9fc-4122-ad38-f7ca13e0ab44 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:05.706103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f65bc-e9fc-4122-ad38-f7ca13e0ab44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:05.706375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f65bc-e9fc-4122-ad38-f7ca13e0ab44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:05.708274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e81f65bc-e9fc-4122-ad38-f7ca13e0ab44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:05.833784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f65bc-e9fc-4122-ad38-f7ca13e0ab44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:05.835230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f65bc-e9fc-4122-ad38-f7ca13e0ab44 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:05.853619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 733/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:07.825290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643bc14-23d3-44fa-9aa6-c0fcf3544560 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:07.825881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643bc14-23d3-44fa-9aa6-c0fcf3544560 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:07.825881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643bc14-23d3-44fa-9aa6-c0fcf3544560 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:07.827190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:07.832795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529eb4-7b15-49ce-b40d-088f022764fa None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:07.833267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529eb4-7b15-49ce-b40d-088f022764fa None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:07.833361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529eb4-7b15-49ce-b40d-088f022764fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:07.909043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:07.912133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-cb529eb4-7b15-49ce-b40d-088f022764fa None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:07.913964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-cb529eb4-7b15-49ce-b40d-088f022764fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:08.017840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:08.296346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643bc14-23d3-44fa-9aa6-c0fcf3544560 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:08.297936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f643bc14-23d3-44fa-9aa6-c0fcf3544560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:08.405313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643bc14-23d3-44fa-9aa6-c0fcf3544560 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:08.470369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:08.496660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa9a07-de8a-48ab-b60d-a5e429d2ecfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:08.497306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa9a07-de8a-48ab-b60d-a5e429d2ecfb service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:08.497582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa9a07-de8a-48ab-b60d-a5e429d2ecfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:08.497846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa9a07-de8a-48ab-b60d-a5e429d2ecfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:08.499463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5baa9a07-de8a-48ab-b60d-a5e429d2ecfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:08.753557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa9a07-de8a-48ab-b60d-a5e429d2ecfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:08.755661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa9a07-de8a-48ab-b60d-a5e429d2ecfb service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:08.779160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 721/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:10.713123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb3dd-a78b-427e-8e3f-0ed53b844c4c None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:10.713921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb3dd-a78b-427e-8e3f-0ed53b844c4c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:10.714113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb3dd-a78b-427e-8e3f-0ed53b844c4c None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:10.715856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:10.723937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61095-9481-4e8b-89c6-d50dea3680bb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:10.724752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61095-9481-4e8b-89c6-d50dea3680bb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:10.724752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61095-9481-4e8b-89c6-d50dea3680bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:10.797763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3ff61095-9481-4e8b-89c6-d50dea3680bb None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:10.799055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3ff61095-9481-4e8b-89c6-d50dea3680bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:10.828502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:10.898849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:11.187515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb3dd-a78b-427e-8e3f-0ed53b844c4c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:11.190011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-590cb3dd-a78b-427e-8e3f-0ed53b844c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:11.312469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb3dd-a78b-427e-8e3f-0ed53b844c4c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:11.344636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:11.392854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917dfa-0556-4306-83d8-98472a22a181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:11.393490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917dfa-0556-4306-83d8-98472a22a181 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:11.393769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917dfa-0556-4306-83d8-98472a22a181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:11.394037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917dfa-0556-4306-83d8-98472a22a181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:11.395978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6c917dfa-0556-4306-83d8-98472a22a181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:11.533080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917dfa-0556-4306-83d8-98472a22a181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:11.534526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917dfa-0556-4306-83d8-98472a22a181 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:11.553381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 736/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:13.654333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56c72-89e6-47f1-a35e-94ac7d4b0ef0 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:13.654840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56c72-89e6-47f1-a35e-94ac7d4b0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:13.654965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56c72-89e6-47f1-a35e-94ac7d4b0ef0 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:13.656268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:13.662031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90621-bf85-4c3c-8aac-d42024cb3207 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:13.662463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90621-bf85-4c3c-8aac-d42024cb3207 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:13.662558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa90621-bf85-4c3c-8aac-d42024cb3207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:13.729730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-2aa90621-bf85-4c3c-8aac-d42024cb3207 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:13.731009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2aa90621-bf85-4c3c-8aac-d42024cb3207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:13.739561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:13.837525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:14.116583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d56c72-89e6-47f1-a35e-94ac7d4b0ef0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:14.119037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f3d56c72-89e6-47f1-a35e-94ac7d4b0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:14.232460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d56c72-89e6-47f1-a35e-94ac7d4b0ef0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:14.291819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:14.312084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de312-f3c5-419f-a6de-41d9d4877aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:14.312617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de312-f3c5-419f-a6de-41d9d4877aea service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:14.312890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de312-f3c5-419f-a6de-41d9d4877aea service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:14.313184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de312-f3c5-419f-a6de-41d9d4877aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:14.314828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d62de312-f3c5-419f-a6de-41d9d4877aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:14.432526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de312-f3c5-419f-a6de-41d9d4877aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:14.434186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de312-f3c5-419f-a6de-41d9d4877aea service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:14.454945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 724/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:16.407301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1876-443a-49a6-ae19-cefd023a4958 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:16.407879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1876-443a-49a6-ae19-cefd023a4958 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:16.407879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc1876-443a-49a6-ae19-cefd023a4958 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:16.409570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:16.415250 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f37b2-18fc-4654-90bf-2b167d3a1f2f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:16.415684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f37b2-18fc-4654-90bf-2b167d3a1f2f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:16.415790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f37b2-18fc-4654-90bf-2b167d3a1f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:16.484487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ae3f37b2-18fc-4654-90bf-2b167d3a1f2f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:16.485733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ae3f37b2-18fc-4654-90bf-2b167d3a1f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:16.526572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:16.589103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:16.873838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc1876-443a-49a6-ae19-cefd023a4958 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:16.876255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3afc1876-443a-49a6-ae19-cefd023a4958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:16.988958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc1876-443a-49a6-ae19-cefd023a4958 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:17.027173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:17.067405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fe435-4434-4917-b0d3-cfdb87bc8bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:17.068002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe435-4434-4917-b0d3-cfdb87bc8bff service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:17.068282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe435-4434-4917-b0d3-cfdb87bc8bff service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:17.068547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fe435-4434-4917-b0d3-cfdb87bc8bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:17.070169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6a9fe435-4434-4917-b0d3-cfdb87bc8bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:17.182414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe435-4434-4917-b0d3-cfdb87bc8bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:17.183775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fe435-4434-4917-b0d3-cfdb87bc8bff service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:17.201752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 739/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:19.153394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e6ef-7b8b-41fb-bbc5-420e63f27864 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:19.153989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e6ef-7b8b-41fb-bbc5-420e63f27864 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:19.153989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e6ef-7b8b-41fb-bbc5-420e63f27864 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:19.155310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:19.162062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea864c-44dd-4e47-906f-8d96b579bfee None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:19.162803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea864c-44dd-4e47-906f-8d96b579bfee None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:19.162951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea864c-44dd-4e47-906f-8d96b579bfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:19.236151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-1fea864c-44dd-4e47-906f-8d96b579bfee None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:19.237442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1fea864c-44dd-4e47-906f-8d96b579bfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:19.257175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:19.361290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:19.646011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6e6ef-7b8b-41fb-bbc5-420e63f27864 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:19.648024 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-59b6e6ef-7b8b-41fb-bbc5-420e63f27864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:19.757214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6e6ef-7b8b-41fb-bbc5-420e63f27864 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:19.832313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:19.839611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd0399-0fb1-4392-94e6-5530cc8e563a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:19.840223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0399-0fb1-4392-94e6-5530cc8e563a service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:19.840498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0399-0fb1-4392-94e6-5530cc8e563a service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:19.840763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd0399-0fb1-4392-94e6-5530cc8e563a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:19.842371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-43fd0399-0fb1-4392-94e6-5530cc8e563a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:19.960511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd0399-0fb1-4392-94e6-5530cc8e563a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:19.961996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd0399-0fb1-4392-94e6-5530cc8e563a service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:19.980578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 727/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:21.892505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a761de-34d1-4fdb-bf3a-df2ee4c6730a None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:21.893513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a761de-34d1-4fdb-bf3a-df2ee4c6730a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:21.894074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a761de-34d1-4fdb-bf3a-df2ee4c6730a None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:21.896584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:13:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:21.905738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e715b3-26f9-42aa-b644-1dda615b7086 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:21.906182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e715b3-26f9-42aa-b644-1dda615b7086 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:21.906287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e715b3-26f9-42aa-b644-1dda615b7086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:21.981555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a5e715b3-26f9-42aa-b644-1dda615b7086 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:21.982761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a5e715b3-26f9-42aa-b644-1dda615b7086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:22.037965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:22.088204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:22.374510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a761de-34d1-4fdb-bf3a-df2ee4c6730a None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:22.376053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-10a761de-34d1-4fdb-bf3a-df2ee4c6730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:22.490514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a761de-34d1-4fdb-bf3a-df2ee4c6730a None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:22.543081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:22.572873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c46bde-ce25-4b3c-99f3-d61a096e8794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:22.573520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c46bde-ce25-4b3c-99f3-d61a096e8794 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:22.573797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c46bde-ce25-4b3c-99f3-d61a096e8794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:22.574064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c46bde-ce25-4b3c-99f3-d61a096e8794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:22.575695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f7c46bde-ce25-4b3c-99f3-d61a096e8794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:22.690995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c46bde-ce25-4b3c-99f3-d61a096e8794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:22.692606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c46bde-ce25-4b3c-99f3-d61a096e8794 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:22.710863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 742/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:32.086440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=22 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:32.708492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=66 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:42.198206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dba9-ea00-4985-a540-d0ee937d0395 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:42.199118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dba9-ea00-4985-a540-d0ee937d0395 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:42.199118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4dba9-ea00-4985-a540-d0ee937d0395 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:42.201318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 729/1471] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:42.208646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a497d-35c1-451f-98a2-ebf8d37487ad None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:42.209126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a497d-35c1-451f-98a2-ebf8d37487ad None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:42.209274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a497d-35c1-451f-98a2-ebf8d37487ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:42.279708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-627a497d-35c1-451f-98a2-ebf8d37487ad None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:42.280911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-627a497d-35c1-451f-98a2-ebf8d37487ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:42.379172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 743/1472] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:42.675242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9bebf-0db6-42d4-9367-653f96d39e66 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:42.675515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9bebf-0db6-42d4-9367-653f96d39e66 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:42.675792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9bebf-0db6-42d4-9367-653f96d39e66 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:42.677138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 730/1473] 10.222.0.17 () {54 vars in 967 bytes} [Wed Aug 31 05:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:42.682347 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bad7-8f98-4f8e-86f3-e99042df541f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:42.682633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bad7-8f98-4f8e-86f3-e99042df541f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:42.682904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4bad7-8f98-4f8e-86f3-e99042df541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:42.759822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4dd4bad7-8f98-4f8e-86f3-e99042df541f None None] MFA Rules not processed for user `24f45db0ea864a3299cccd7a74b7271b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:42.761008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4dd4bad7-8f98-4f8e-86f3-e99042df541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:42.781991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:42.839654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 744/1474] 10.222.0.17 () {58 vars in 1064 bytes} [Wed Aug 31 05:13:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:42.847461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9bebf-0db6-42d4-9367-653f96d39e66 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:42.848943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a2a9bebf-0db6-42d4-9367-653f96d39e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:42.966037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9bebf-0db6-42d4-9367-653f96d39e66 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:43.051811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d1fc-8a94-49eb-bb89-11a17b5930b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f45db0ea864a3299cccd7a74b7271b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:43.052562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d1fc-8a94-49eb-bb89-11a17b5930b2 service glance] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:43.052865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d1fc-8a94-49eb-bb89-11a17b5930b2 service glance] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:43.053210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d1fc-8a94-49eb-bb89-11a17b5930b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:43.055666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4096d1fc-8a94-49eb-bb89-11a17b5930b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:43.121760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:43.190371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d1fc-8a94-49eb-bb89-11a17b5930b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:43.191817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d1fc-8a94-49eb-bb89-11a17b5930b2 service glance] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:43.210939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 731/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:45.208216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dabc6-6a02-49c1-a4e8-29ecb8f74827 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:45.208803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dabc6-6a02-49c1-a4e8-29ecb8f74827 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:45.208803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dabc6-6a02-49c1-a4e8-29ecb8f74827 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:45.211005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 745/1476] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:45.219134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557b8e-92d3-445a-a0e0-4c646e1ae316 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:45.219625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557b8e-92d3-445a-a0e0-4c646e1ae316 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:45.219625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557b8e-92d3-445a-a0e0-4c646e1ae316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:45.292964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1b557b8e-92d3-445a-a0e0-4c646e1ae316 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:45.294662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1b557b8e-92d3-445a-a0e0-4c646e1ae316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:45.401583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 732/1477] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:13:45.670018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dabc6-6a02-49c1-a4e8-29ecb8f74827 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:45.671564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3b0dabc6-6a02-49c1-a4e8-29ecb8f74827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:45.808604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dabc6-6a02-49c1-a4e8-29ecb8f74827 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:45.857923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:45.906819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd63bc4-44db-4f75-af0b-116c979eb7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:45.907342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63bc4-44db-4f75-af0b-116c979eb7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:45.907615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63bc4-44db-4f75-af0b-116c979eb7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:45.907883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63bc4-44db-4f75-af0b-116c979eb7b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:45.908625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd63bc4-44db-4f75-af0b-116c979eb7b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:45.910467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING py.warnings [None req-9cd63bc4-44db-4f75-af0b-116c979eb7b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:13:45.910467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: warnings.warn(msg) Aug 31 05:13:45.910467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: Aug 31 05:13:45.911604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd63bc4-44db-4f75-af0b-116c979eb7b8 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:45.931576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 746/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Aug 31 05:13:45 2022] GET /identity/v3/projects => generated 2553 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:13:47.846361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35951999-df58-46de-9e6b-6f6187eb6806 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:47.846958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35951999-df58-46de-9e6b-6f6187eb6806 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:47.846958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35951999-df58-46de-9e6b-6f6187eb6806 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:47.848839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 733/1479] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:47.857053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51619b0-fbbe-44e7-a89a-3596a3d4ecf3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:47.857507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51619b0-fbbe-44e7-a89a-3596a3d4ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:47.857650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51619b0-fbbe-44e7-a89a-3596a3d4ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:47.936313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f51619b0-fbbe-44e7-a89a-3596a3d4ecf3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:47.937486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f51619b0-fbbe-44e7-a89a-3596a3d4ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:48.047593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 747/1480] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:48.338668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35951999-df58-46de-9e6b-6f6187eb6806 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:48.340385 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-35951999-df58-46de-9e6b-6f6187eb6806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:48.350859 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:48.496331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35951999-df58-46de-9e6b-6f6187eb6806 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:48.585326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:48.619500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cca196-6dbc-4d91-8b51-b6cffd7133b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:48.620112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cca196-6dbc-4d91-8b51-b6cffd7133b2 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:48.620389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cca196-6dbc-4d91-8b51-b6cffd7133b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:48.620660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cca196-6dbc-4d91-8b51-b6cffd7133b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:48.622321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-45cca196-6dbc-4d91-8b51-b6cffd7133b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:48.729971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cca196-6dbc-4d91-8b51-b6cffd7133b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:48.731574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cca196-6dbc-4d91-8b51-b6cffd7133b2 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:48.756034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 734/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:50.915704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a667-7264-488e-934e-340bab175fda None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:50.916403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a667-7264-488e-934e-340bab175fda None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:50.916403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a667-7264-488e-934e-340bab175fda None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:50.918042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 748/1482] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:50.923940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ba54-cc73-4ecd-8251-b4b96306a278 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:50.924486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ba54-cc73-4ecd-8251-b4b96306a278 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:50.924590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ba54-cc73-4ecd-8251-b4b96306a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:50.994052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1799ba54-cc73-4ecd-8251-b4b96306a278 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:50.995260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1799ba54-cc73-4ecd-8251-b4b96306a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:51.042020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:51.106428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 735/1483] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:51.407178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a667-7264-488e-934e-340bab175fda None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:51.409494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2d83a667-7264-488e-934e-340bab175fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:51.440074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:51.523067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a667-7264-488e-934e-340bab175fda None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:51.730327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7b0de-cb25-4537-a86c-f9436739b69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:51.730943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b0de-cb25-4537-a86c-f9436739b69d service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:51.731217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b0de-cb25-4537-a86c-f9436739b69d service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:51.731483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7b0de-cb25-4537-a86c-f9436739b69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:51.733120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e5f7b0de-cb25-4537-a86c-f9436739b69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:51.810099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:51.846891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7b0de-cb25-4537-a86c-f9436739b69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:51.848328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7b0de-cb25-4537-a86c-f9436739b69d service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:51.868747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 749/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:53.862498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3bf6-bb85-49b2-8940-3412090332f6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:53.863367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3bf6-bb85-49b2-8940-3412090332f6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:53.863493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3bf6-bb85-49b2-8940-3412090332f6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:53.865616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 736/1485] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:13:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:53.873707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad9b18-c6ba-4256-9aab-dfa7f053861d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:53.874168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad9b18-c6ba-4256-9aab-dfa7f053861d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:53.874276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad9b18-c6ba-4256-9aab-dfa7f053861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:53.943798 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0aad9b18-c6ba-4256-9aab-dfa7f053861d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:53.944926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0aad9b18-c6ba-4256-9aab-dfa7f053861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:54.046151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 750/1486] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:13:54.336391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c3bf6-bb85-49b2-8940-3412090332f6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:54.337995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7c8c3bf6-bb85-49b2-8940-3412090332f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:54.453637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c3bf6-bb85-49b2-8940-3412090332f6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:54.528864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:54.530727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7557a-ac44-4c0e-935a-f4f7f7356510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:54.531344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7557a-ac44-4c0e-935a-f4f7f7356510 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:54.531625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7557a-ac44-4c0e-935a-f4f7f7356510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:54.531901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7557a-ac44-4c0e-935a-f4f7f7356510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:54.534714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bba7557a-ac44-4c0e-935a-f4f7f7356510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:54.653201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7557a-ac44-4c0e-935a-f4f7f7356510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:54.654648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7557a-ac44-4c0e-935a-f4f7f7356510 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:54.672730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 737/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:56.740327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c345e-fc21-4004-9da5-de35ed8220d3 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:56.741289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c345e-fc21-4004-9da5-de35ed8220d3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:56.741289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c345e-fc21-4004-9da5-de35ed8220d3 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:56.743270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 751/1488] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:13:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:56.752215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2d96-cb0e-4119-a3bc-bcaa8c85a241 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:56.752674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2d96-cb0e-4119-a3bc-bcaa8c85a241 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:56.752778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c2d96-cb0e-4119-a3bc-bcaa8c85a241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:56.837663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3c5c2d96-cb0e-4119-a3bc-bcaa8c85a241 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:56.838905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3c5c2d96-cb0e-4119-a3bc-bcaa8c85a241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:56.895278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:56.942586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 738/1489] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:13:57.235923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c345e-fc21-4004-9da5-de35ed8220d3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:13:57.237616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-bd1c345e-fc21-4004-9da5-de35ed8220d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:57.276903 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:57.363450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c345e-fc21-4004-9da5-de35ed8220d3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:13:57.447399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80d023-5d6f-4139-8437-3db3a9e3881c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:13:57.448009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d023-5d6f-4139-8437-3db3a9e3881c service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:57.448280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d023-5d6f-4139-8437-3db3a9e3881c service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:57.448544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80d023-5d6f-4139-8437-3db3a9e3881c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:57.450205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-dc80d023-5d6f-4139-8437-3db3a9e3881c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:57.540006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:13:57.570230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80d023-5d6f-4139-8437-3db3a9e3881c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:13:57.571648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80d023-5d6f-4139-8437-3db3a9e3881c service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:13:57.590349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 752/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:13:59.698747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9bd6-f08a-49de-a7f4-2124e9b0187a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:59.699653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9bd6-f08a-49de-a7f4-2124e9b0187a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:59.699653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9bd6-f08a-49de-a7f4-2124e9b0187a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:59.702034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 739/1491] 10.222.0.17 () {54 vars in 927 bytes} [Wed Aug 31 05:13:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:13:59.707695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd1ca8-3f57-423f-bd96-2a15e21555dc None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:13:59.708144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd1ca8-3f57-423f-bd96-2a15e21555dc None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:13:59.708272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd1ca8-3f57-423f-bd96-2a15e21555dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:13:59.776335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-98dd1ca8-3f57-423f-bd96-2a15e21555dc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:13:59.777586 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-98dd1ca8-3f57-423f-bd96-2a15e21555dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:13:59.893341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 753/1492] 10.222.0.17 () {58 vars in 1024 bytes} [Wed Aug 31 05:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:14:00.186847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9bd6-f08a-49de-a7f4-2124e9b0187a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:14:00.189674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7a4b9bd6-f08a-49de-a7f4-2124e9b0187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:14:00.312228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9bd6-f08a-49de-a7f4-2124e9b0187a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:14:00.389893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d458aba-4d32-4e04-91bd-bedbe3b2029a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:14:00.390510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458aba-4d32-4e04-91bd-bedbe3b2029a service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:14:00.390784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458aba-4d32-4e04-91bd-bedbe3b2029a service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:14:00.391050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d458aba-4d32-4e04-91bd-bedbe3b2029a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:14:00.392926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4d458aba-4d32-4e04-91bd-bedbe3b2029a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:14:00.402986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:14:00.512486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d458aba-4d32-4e04-91bd-bedbe3b2029a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:14:00.513873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d458aba-4d32-4e04-91bd-bedbe3b2029a service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:14:00.532962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 740/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:14:09.891146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=82 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:14:10.530490 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=50 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:13.746285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8bfb-51ab-453c-9186-411338bb08e9 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:13.747250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8bfb-51ab-453c-9186-411338bb08e9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:13.747250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b8bfb-51ab-453c-9186-411338bb08e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:13.838307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-037b8bfb-51ab-453c-9186-411338bb08e9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:15:13.839499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-037b8bfb-51ab-453c-9186-411338bb08e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:13.946361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 754/1494] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:15:13.957398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438fff-7cf0-4fb5-b2c8-b2c0200fb619 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:13.957939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438fff-7cf0-4fb5-b2c8-b2c0200fb619 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:13.957939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438fff-7cf0-4fb5-b2c8-b2c0200fb619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:14.047708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9e438fff-7cf0-4fb5-b2c8-b2c0200fb619 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:15:14.049418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9e438fff-7cf0-4fb5-b2c8-b2c0200fb619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:14.160611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 741/1495] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:15:14.167814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b8bfb-51ab-453c-9186-411338bb08e9 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:14.169643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-037b8bfb-51ab-453c-9186-411338bb08e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:14.187465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b8bfb-51ab-453c-9186-411338bb08e9 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:14.250150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:14.285467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:14.286067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:14.286335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:14.286596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:14.287235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:15:14.287522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:14.288523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING py.warnings [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:15:14.288523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: warnings.warn(msg) Aug 31 05:15:14.288523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: Aug 31 05:15:14.289425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:14.300652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 755/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:15:14.309424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438fff-7cf0-4fb5-b2c8-b2c0200fb619 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:14.323863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438fff-7cf0-4fb5-b2c8-b2c0200fb619 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:14.407098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:14.448251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:14.448888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:14.449160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:14.449453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:14.450077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:14.451809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:15:14.451809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: warnings.warn(msg) Aug 31 05:15:14.451809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: Aug 31 05:15:14.452999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:14.514039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 742/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:15:14 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:15:14.518592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:14.520189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:14.557042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078d749-a282-4212-bcd4-4d5ce8111706 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:14.662272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:14.662889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:14.663166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:14.663429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:14.664057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:14.665068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING py.warnings [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:15:14.665068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: warnings.warn(msg) Aug 31 05:15:14.665068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: Aug 31 05:15:14.666307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:14.720724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 756/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:15:14 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:15:14.725070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:14.726665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:14.796079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3efd3-5d16-4380-9ac1-87eedb76a15d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:14.891292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:14.904199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:14.904817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:14.905119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:14.905388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:14.906586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:14.907702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:15:14.907702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: warnings.warn(msg) Aug 31 05:15:14.907702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: Aug 31 05:15:14.908732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:14.921631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 743/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:15:14.925924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:14.927469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:14.939521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997bed5-05fe-44e7-b9af-835b15b7a509 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:14.966814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:15.041558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31933b8e-a95e-443f-b3ed-aff9e298f760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:15.042156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933b8e-a95e-443f-b3ed-aff9e298f760 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:15.042425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933b8e-a95e-443f-b3ed-aff9e298f760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:15.042686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933b8e-a95e-443f-b3ed-aff9e298f760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:15.043323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31933b8e-a95e-443f-b3ed-aff9e298f760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:15.044321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING py.warnings [None req-31933b8e-a95e-443f-b3ed-aff9e298f760 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:15:15.044321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: warnings.warn(msg) Aug 31 05:15:15.044321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: Aug 31 05:15:15.045211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31933b8e-a95e-443f-b3ed-aff9e298f760 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:15.057733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 757/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:15:15.062817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:15.064488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:15.098382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7728d-4be3-4b9c-a82f-3dace872dbb6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:15.207272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7ba73-46bf-4d69-8c2a-629ec4dca904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:15.207944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7ba73-46bf-4d69-8c2a-629ec4dca904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:15.208217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7ba73-46bf-4d69-8c2a-629ec4dca904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:15.208481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7ba73-46bf-4d69-8c2a-629ec4dca904 admin admin] PATH_INFO: `/v3/projects/924d353ad6ff4227ac0e140f91f48ff7/users/5ab7f6cb355a46829241df15bd6dfd7f/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:15.232019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7ba73-46bf-4d69-8c2a-629ec4dca904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924d353ad6ff4227ac0e140f91f48ff7, user_id=5ab7f6cb355a46829241df15bd6dfd7f, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:15.233055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-aee7ba73-46bf-4d69-8c2a-629ec4dca904 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:15:15.233055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: warnings.warn(msg) Aug 31 05:15:15.233055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: Aug 31 05:15:15.234986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7ba73-46bf-4d69-8c2a-629ec4dca904 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:15.267220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 744/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:15:15 2022] PUT /identity/v3/projects/924d353ad6ff4227ac0e140f91f48ff7/users/5ab7f6cb355a46829241df15bd6dfd7f/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:15:15.280319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce820cbf-abff-49bc-a720-fc2bfaced666 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:15.280593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce820cbf-abff-49bc-a720-fc2bfaced666 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:15.280870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce820cbf-abff-49bc-a720-fc2bfaced666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:15.341064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ce820cbf-abff-49bc-a720-fc2bfaced666 None None] MFA Rules not processed for user `5ab7f6cb355a46829241df15bd6dfd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:15:15.342328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ce820cbf-abff-49bc-a720-fc2bfaced666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:15.433712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 758/1502] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:15:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:15:15.447624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c63a-17ac-4b42-b715-88cc53382e9d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:15.447913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c63a-17ac-4b42-b715-88cc53382e9d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:15.448183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507c63a-17ac-4b42-b715-88cc53382e9d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:15.449604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 745/1503] 10.222.0.17 () {54 vars in 964 bytes} [Wed Aug 31 05:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:15:15.455816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65343c-e1e4-4f22-9cf6-06c84ed26b76 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:15.456105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65343c-e1e4-4f22-9cf6-06c84ed26b76 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:15.456398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65343c-e1e4-4f22-9cf6-06c84ed26b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:15.489427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:15.553119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fd65343c-e1e4-4f22-9cf6-06c84ed26b76 None None] MFA Rules not processed for user `75e27abf26954289b3fcffa332e155a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:15:15.554437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fd65343c-e1e4-4f22-9cf6-06c84ed26b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:15.640282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 759/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Aug 31 05:15:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:15:15.650770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507c63a-17ac-4b42-b715-88cc53382e9d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:15.652304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f507c63a-17ac-4b42-b715-88cc53382e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:15.710055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:15.777953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507c63a-17ac-4b42-b715-88cc53382e9d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:15.881422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:15.882452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:15.882842 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:15.883304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:15.886114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:16.032710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:16.034423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:16.038790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:16.057404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 746/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:15:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:15:16.112453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ebc14-8198-4269-93d4-4316e20324cf None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:16.112870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ebc14-8198-4269-93d4-4316e20324cf None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:16.113003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ebc14-8198-4269-93d4-4316e20324cf None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:16.114504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 760/1506] 10.222.0.17 () {52 vars in 830 bytes} [Wed Aug 31 05:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:15:16.118699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:16.119925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:16.247319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f004f-1541-4272-a036-7acafa5ec68f service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:16.369639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:16.370641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:16.370985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:16.371300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] PATH_INFO: `/v3/users/5ab7f6cb355a46829241df15bd6dfd7f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:16.386316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab7f6cb355a46829241df15bd6dfd7f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:16.387365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:15:16.387365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: warnings.warn(msg) Aug 31 05:15:16.387365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: Aug 31 05:15:16.388566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:16.400947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:16.474828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab7f6cb355a46829241df15bd6dfd7f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:16.505429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab7f6cb355a46829241df15bd6dfd7f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:16.526830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab7f6cb355a46829241df15bd6dfd7f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:16.540664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab7f6cb355a46829241df15bd6dfd7f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:16.541208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab7f6cb355a46829241df15bd6dfd7f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:16.547492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 747/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:15:16 2022] DELETE /identity/v3/users/5ab7f6cb355a46829241df15bd6dfd7f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:15:16.554655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e6999-2fe9-43a6-8747-52a546de79e1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:16.554937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e6999-2fe9-43a6-8747-52a546de79e1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:16.555212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e6999-2fe9-43a6-8747-52a546de79e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:16.634584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-227e6999-2fe9-43a6-8747-52a546de79e1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:15:16.635855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-227e6999-2fe9-43a6-8747-52a546de79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:16.718612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:16.734884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 761/1508] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:15:16.744985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:16.746277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:16.856451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5be23-699c-4065-904f-1cb425adc60e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:16.913695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:16.936422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714b0f9-89df-4e9e-aa2b-cda4f1c395af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:16.937050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b0f9-89df-4e9e-aa2b-cda4f1c395af service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:16.937357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b0f9-89df-4e9e-aa2b-cda4f1c395af service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:16.937626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b0f9-89df-4e9e-aa2b-cda4f1c395af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:16.939260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2714b0f9-89df-4e9e-aa2b-cda4f1c395af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:17.060843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714b0f9-89df-4e9e-aa2b-cda4f1c395af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:17.062323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714b0f9-89df-4e9e-aa2b-cda4f1c395af service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:17.082094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 748/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:15:17.421665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e6999-2fe9-43a6-8747-52a546de79e1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:15:17.423321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-227e6999-2fe9-43a6-8747-52a546de79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:15:17.435729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e6999-2fe9-43a6-8747-52a546de79e1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:15:17.534237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:15:17.534871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:15:17.535141 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:15:17.535402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] PATH_INFO: `/v3/projects/924d353ad6ff4227ac0e140f91f48ff7` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:15:17.545901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924d353ad6ff4227ac0e140f91f48ff7)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:15:17.546918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING py.warnings [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:15:17.546918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: warnings.warn(msg) Aug 31 05:15:17.546918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: Aug 31 05:15:17.548127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:15:17.609428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924d353ad6ff4227ac0e140f91f48ff7', 'request_id': 'req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:17.615788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924d353ad6ff4227ac0e140f91f48ff7', 'request_id': 'req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:17.629833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924d353ad6ff4227ac0e140f91f48ff7', 'request_id': 'req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:17.669059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] The token cache is being invalidate because project 924d353ad6ff4227ac0e140f91f48ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:15:17.669338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:17.669980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8017eae5-6924-47b6-a37b-de9e4e6c5ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:15:17.671802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 762/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:15:17 2022] DELETE /identity/v3/projects/924d353ad6ff4227ac0e140f91f48ff7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:15:27.079496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=62 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:15:27.665614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:16:47.847645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223cd0b-4614-43c9-bfb5-4cbfae012bbc None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:47.848602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223cd0b-4614-43c9-bfb5-4cbfae012bbc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:47.848602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223cd0b-4614-43c9-bfb5-4cbfae012bbc None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:47.850981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:16:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:16:47.856051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449cb3-f6e5-4d96-8354-065ea5044225 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:47.856507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449cb3-f6e5-4d96-8354-065ea5044225 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:47.856616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449cb3-f6e5-4d96-8354-065ea5044225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:47.954380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-97449cb3-f6e5-4d96-8354-065ea5044225 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:16:47.955531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-97449cb3-f6e5-4d96-8354-065ea5044225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:16:48.062909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:16:48.241218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223cd0b-4614-43c9-bfb5-4cbfae012bbc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:16:48.244837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1223cd0b-4614-43c9-bfb5-4cbfae012bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:16:48.376833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223cd0b-4614-43c9-bfb5-4cbfae012bbc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:16:48.382899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be575023-8396-4297-aeaf-7e0874e1c080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:16:48.383512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575023-8396-4297-aeaf-7e0874e1c080 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:48.383789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575023-8396-4297-aeaf-7e0874e1c080 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:48.384041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be575023-8396-4297-aeaf-7e0874e1c080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:48.392335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be575023-8396-4297-aeaf-7e0874e1c080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:16:48.393953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be575023-8396-4297-aeaf-7e0874e1c080 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:16:48.403867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 750/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:16:49.247198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e23e8-77ae-4899-b57c-d480e514308e None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:49.248162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e23e8-77ae-4899-b57c-d480e514308e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:49.248162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e23e8-77ae-4899-b57c-d480e514308e None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:49.250316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:16:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:16:49.256174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e01dc3-5813-4679-9300-19bce249adf2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:49.256901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e01dc3-5813-4679-9300-19bce249adf2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:49.257113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e01dc3-5813-4679-9300-19bce249adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:49.279229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-85e01dc3-5813-4679-9300-19bce249adf2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:16:49.280459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-85e01dc3-5813-4679-9300-19bce249adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:16:49.288904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:16:49.443322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e23e8-77ae-4899-b57c-d480e514308e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:16:49.460172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e23e8-77ae-4899-b57c-d480e514308e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:16:49.466973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a7c45-e43e-49d0-a397-c842742be1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:16:49.467556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7c45-e43e-49d0-a397-c842742be1f9 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:49.467889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7c45-e43e-49d0-a397-c842742be1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:49.468232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a7c45-e43e-49d0-a397-c842742be1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:49.477046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a7c45-e43e-49d0-a397-c842742be1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:16:49.478757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a7c45-e43e-49d0-a397-c842742be1f9 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:16:49.488481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 765/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:16:49.869197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cdf6-2c26-4646-bf7c-4f76a4553337 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:49.869472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cdf6-2c26-4646-bf7c-4f76a4553337 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:49.869852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87cdf6-2c26-4646-bf7c-4f76a4553337 None None] PATH_INFO: `/v3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:49.871216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 752/1517] 10.222.0.30 () {54 vars in 925 bytes} [Wed Aug 31 05:16:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:16:49.877827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb7ec7-6a3b-4f90-83b3-a4bd28f290de None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:49.878117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb7ec7-6a3b-4f90-83b3-a4bd28f290de None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:49.878388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb7ec7-6a3b-4f90-83b3-a4bd28f290de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:49.942168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-21fb7ec7-6a3b-4f90-83b3-a4bd28f290de None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:16:49.943379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-21fb7ec7-6a3b-4f90-83b3-a4bd28f290de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:16:49.961998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:16:50.027119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 766/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 31 05:16:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:16:53.863860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece21c-4c1f-4bc1-8d17-2a0dcf4aea33 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:53.864409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece21c-4c1f-4bc1-8d17-2a0dcf4aea33 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:53.864409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ece21c-4c1f-4bc1-8d17-2a0dcf4aea33 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:53.866303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 753/1519] 10.222.0.17 () {54 vars in 961 bytes} [Wed Aug 31 05:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:16:53.872058 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5905-8632-45bb-954d-5c6cca4f3cd2 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:53.872507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5905-8632-45bb-954d-5c6cca4f3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:53.872618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f5905-8632-45bb-954d-5c6cca4f3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:53.901435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-150f5905-8632-45bb-954d-5c6cca4f3cd2 None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:16:53.902668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-150f5905-8632-45bb-954d-5c6cca4f3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:16:53.912526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 767/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Aug 31 05:16:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:16:53.920957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ece21c-4c1f-4bc1-8d17-2a0dcf4aea33 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:16:53.937000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ece21c-4c1f-4bc1-8d17-2a0dcf4aea33 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:16:53.942440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ddea-ddf0-408f-91d9-b9d58f230f83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:16:53.943038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ddea-ddf0-408f-91d9-b9d58f230f83 service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:16:53.943313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ddea-ddf0-408f-91d9-b9d58f230f83 service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:16:53.943581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ddea-ddf0-408f-91d9-b9d58f230f83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:16:53.952487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ddea-ddf0-408f-91d9-b9d58f230f83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:16:53.954102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ddea-ddf0-408f-91d9-b9d58f230f83 service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:16:53.964001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 754/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:16:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:17:00.726898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8547a4-5668-43bb-8598-c25872034293 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:00.727892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8547a4-5668-43bb-8598-c25872034293 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:00.727892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8547a4-5668-43bb-8598-c25872034293 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:00.729716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:17:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:17:00.736019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7486-39bb-418c-a683-e4ebd0282c1e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:00.736468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7486-39bb-418c-a683-e4ebd0282c1e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:00.736571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7486-39bb-418c-a683-e4ebd0282c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:00.757819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6bfa7486-39bb-418c-a683-e4ebd0282c1e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:17:00.759044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6bfa7486-39bb-418c-a683-e4ebd0282c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:00.768719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:17:00.925206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8547a4-5668-43bb-8598-c25872034293 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:17:00.940684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8547a4-5668-43bb-8598-c25872034293 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:17:00.947205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f10fa6-9267-4d22-88bf-57471e50cc0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:17:00.947797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10fa6-9267-4d22-88bf-57471e50cc0f service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:00.948047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10fa6-9267-4d22-88bf-57471e50cc0f service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:00.948316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10fa6-9267-4d22-88bf-57471e50cc0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:00.958012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f10fa6-9267-4d22-88bf-57471e50cc0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:17:00.959606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f10fa6-9267-4d22-88bf-57471e50cc0f service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:17:00.969382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 769/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:17:01.783142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca033bd-027f-4d4f-9886-0e080fb12404 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:01.783942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca033bd-027f-4d4f-9886-0e080fb12404 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:01.783942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca033bd-027f-4d4f-9886-0e080fb12404 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:01.786130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 05:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:17:01.791104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee54f4-96d1-4140-96f9-cf20c3ac0a70 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:01.791545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee54f4-96d1-4140-96f9-cf20c3ac0a70 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:01.791658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee54f4-96d1-4140-96f9-cf20c3ac0a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:01.812239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b5ee54f4-96d1-4140-96f9-cf20c3ac0a70 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:17:01.813476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b5ee54f4-96d1-4140-96f9-cf20c3ac0a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:01.821919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 05:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:17:01.978028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca033bd-027f-4d4f-9886-0e080fb12404 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:17:02.002512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca033bd-027f-4d4f-9886-0e080fb12404 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:17:02.009387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac318546-f916-4b0d-b4dc-7e1a4faa4704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:17:02.010068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318546-f916-4b0d-b4dc-7e1a4faa4704 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:02.010225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318546-f916-4b0d-b4dc-7e1a4faa4704 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:02.010535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318546-f916-4b0d-b4dc-7e1a4faa4704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:02.019107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac318546-f916-4b0d-b4dc-7e1a4faa4704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:17:02.020698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac318546-f916-4b0d-b4dc-7e1a4faa4704 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:17:02.030993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 757/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:17:05.756494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdddde9-6414-4e1d-b0f7-674591ef400b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:05.757469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdddde9-6414-4e1d-b0f7-674591ef400b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:05.757469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdddde9-6414-4e1d-b0f7-674591ef400b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:05.759630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:17:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:17:05.765980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4c2f7-ec3d-42de-b69e-7d739713e0fe None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:05.766783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4c2f7-ec3d-42de-b69e-7d739713e0fe None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:05.766963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4c2f7-ec3d-42de-b69e-7d739713e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:05.793056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dbe4c2f7-ec3d-42de-b69e-7d739713e0fe None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:17:05.794287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dbe4c2f7-ec3d-42de-b69e-7d739713e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:05.802935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:17:06.091862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdddde9-6414-4e1d-b0f7-674591ef400b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:17:06.095045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-dbdddde9-6414-4e1d-b0f7-674591ef400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:06.185694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdddde9-6414-4e1d-b0f7-674591ef400b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:17:06.189787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc44e60-1cf0-478b-823a-941eebea89d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:17:06.190398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44e60-1cf0-478b-823a-941eebea89d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:06.190675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44e60-1cf0-478b-823a-941eebea89d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:06.190946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc44e60-1cf0-478b-823a-941eebea89d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:06.200705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc44e60-1cf0-478b-823a-941eebea89d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:17:06.202207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc44e60-1cf0-478b-823a-941eebea89d3 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:17:06.211894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 772/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:17:08.085299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d6496-1f03-4281-beb8-988839663a13 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:08.085891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d6496-1f03-4281-beb8-988839663a13 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:08.085891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d6496-1f03-4281-beb8-988839663a13 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:08.087260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:17:08.094264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3d25-8282-4bd1-b95d-494d57c80f3f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:08.095008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3d25-8282-4bd1-b95d-494d57c80f3f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:08.095008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3d25-8282-4bd1-b95d-494d57c80f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:08.126482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-810e3d25-8282-4bd1-b95d-494d57c80f3f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:17:08.127691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-810e3d25-8282-4bd1-b95d-494d57c80f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:08.137066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:17:08.422352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d6496-1f03-4281-beb8-988839663a13 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:17:08.434184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d6496-1f03-4281-beb8-988839663a13 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:17:08.438535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c84a8-04f5-4c8e-a983-13f13c136596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:17:08.439135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c84a8-04f5-4c8e-a983-13f13c136596 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:08.439409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c84a8-04f5-4c8e-a983-13f13c136596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:08.439676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c84a8-04f5-4c8e-a983-13f13c136596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:08.454418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c84a8-04f5-4c8e-a983-13f13c136596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:17:08.455855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c84a8-04f5-4c8e-a983-13f13c136596 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:17:08.465640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 760/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:17:11.733879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83eb0b-c044-4d3e-8200-cfd349fc311b None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:11.734506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83eb0b-c044-4d3e-8200-cfd349fc311b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:11.734506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83eb0b-c044-4d3e-8200-cfd349fc311b None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:11.735786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:17:11.742170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962d71e-79e7-47f3-bf1e-bdbb7b86d0e1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:11.742638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962d71e-79e7-47f3-bf1e-bdbb7b86d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:11.742748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962d71e-79e7-47f3-bf1e-bdbb7b86d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:11.767361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f962d71e-79e7-47f3-bf1e-bdbb7b86d0e1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:17:11.768569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f962d71e-79e7-47f3-bf1e-bdbb7b86d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:11.778380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:17:12.335656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83eb0b-c044-4d3e-8200-cfd349fc311b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:17:12.337761 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5e83eb0b-c044-4d3e-8200-cfd349fc311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:12.408394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:17:12.424168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83eb0b-c044-4d3e-8200-cfd349fc311b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:17:12.428307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debf40-6bcf-4a67-8924-a1a8839cca13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:17:12.428960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debf40-6bcf-4a67-8924-a1a8839cca13 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:12.429274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debf40-6bcf-4a67-8924-a1a8839cca13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:12.429549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debf40-6bcf-4a67-8924-a1a8839cca13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:12.439443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1debf40-6bcf-4a67-8924-a1a8839cca13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:17:12.440804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1debf40-6bcf-4a67-8924-a1a8839cca13 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:17:12.450166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 775/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:17:14.360505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8cb83-ea46-47ac-8de8-c13afa2a48f5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:14.361079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8cb83-ea46-47ac-8de8-c13afa2a48f5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:14.361079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8cb83-ea46-47ac-8de8-c13afa2a48f5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:14.362457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 05:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:17:14.368575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf528-91ab-4c96-bb76-19d52cb022a1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:14.369011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf528-91ab-4c96-bb76-19d52cb022a1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:14.369232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf528-91ab-4c96-bb76-19d52cb022a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:14.392095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-65edf528-91ab-4c96-bb76-19d52cb022a1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:17:14.393367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-65edf528-91ab-4c96-bb76-19d52cb022a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:14.404673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 05:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:17:14.953467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8cb83-ea46-47ac-8de8-c13afa2a48f5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:17:14.955791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b8b8cb83-ea46-47ac-8de8-c13afa2a48f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:17:14.975233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8cb83-ea46-47ac-8de8-c13afa2a48f5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:17:14.981819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8b3d-df03-4883-b076-f941bd7cff52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:17:14.982679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8b3d-df03-4883-b076-f941bd7cff52 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:17:14.982952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8b3d-df03-4883-b076-f941bd7cff52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:17:14.983222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8b3d-df03-4883-b076-f941bd7cff52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:17:14.993355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a8b3d-df03-4883-b076-f941bd7cff52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:17:14.994792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a8b3d-df03-4883-b076-f941bd7cff52 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:17:15.004526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 763/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:17:24.386105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=11 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:17:25.001020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:41.196224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8dde-1326-4cc1-9437-07b7ef7ca0e6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.196909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8dde-1326-4cc1-9437-07b7ef7ca0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.196909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8dde-1326-4cc1-9437-07b7ef7ca0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.224425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-59ba8dde-1326-4cc1-9437-07b7ef7ca0e6 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.225604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-59ba8dde-1326-4cc1-9437-07b7ef7ca0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.238812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 777/1540] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.248645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401197a-1d34-42af-81f4-da18f8adeb7c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.249274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401197a-1d34-42af-81f4-da18f8adeb7c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.249274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401197a-1d34-42af-81f4-da18f8adeb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.277245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e401197a-1d34-42af-81f4-da18f8adeb7c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.278486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e401197a-1d34-42af-81f4-da18f8adeb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.296855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 764/1541] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.301197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba8dde-1326-4cc1-9437-07b7ef7ca0e6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.311679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba8dde-1326-4cc1-9437-07b7ef7ca0e6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.323481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f405ab-9c16-449f-bc31-6b95776f40de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.324110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f405ab-9c16-449f-bc31-6b95776f40de admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.324391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f405ab-9c16-449f-bc31-6b95776f40de admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.324658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f405ab-9c16-449f-bc31-6b95776f40de admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.325344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f405ab-9c16-449f-bc31-6b95776f40de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:41.325871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f405ab-9c16-449f-bc31-6b95776f40de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.327486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f405ab-9c16-449f-bc31-6b95776f40de admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.340997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 778/1542] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:41.348956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401197a-1d34-42af-81f4-da18f8adeb7c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.359475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401197a-1d34-42af-81f4-da18f8adeb7c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.367715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96770c8-c55a-4c2a-8778-1f2454b24c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.368107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96770c8-c55a-4c2a-8778-1f2454b24c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.368301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96770c8-c55a-4c2a-8778-1f2454b24c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.368572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96770c8-c55a-4c2a-8778-1f2454b24c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.369264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96770c8-c55a-4c2a-8778-1f2454b24c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.371442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96770c8-c55a-4c2a-8778-1f2454b24c0f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.412409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8348c-75c0-4cf2-ad34-48baffe59568 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.412772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8348c-75c0-4cf2-ad34-48baffe59568 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.413019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8348c-75c0-4cf2-ad34-48baffe59568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.450392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 765/1543] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:41.451772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050295-0177-49e8-b21f-c2bc455d6cff None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.452059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050295-0177-49e8-b21f-c2bc455d6cff None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.452333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39050295-0177-49e8-b21f-c2bc455d6cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.458416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-eab8348c-75c0-4cf2-ad34-48baffe59568 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.459654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-eab8348c-75c0-4cf2-ad34-48baffe59568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.498325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-39050295-0177-49e8-b21f-c2bc455d6cff None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.499499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-39050295-0177-49e8-b21f-c2bc455d6cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.580998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 779/1544] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:18:41.581906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8348c-75c0-4cf2-ad34-48baffe59568 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.596975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8348c-75c0-4cf2-ad34-48baffe59568 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.605521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe16a3-448a-4ab8-b667-c60d1c3e29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.606574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe16a3-448a-4ab8-b667-c60d1c3e29f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.607081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe16a3-448a-4ab8-b667-c60d1c3e29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.607567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe16a3-448a-4ab8-b667-c60d1c3e29f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.608519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe16a3-448a-4ab8-b667-c60d1c3e29f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.610874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe16a3-448a-4ab8-b667-c60d1c3e29f7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.611135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 766/1545] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.612295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233394b-dc4a-462c-a9e2-19787178d145 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.612580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233394b-dc4a-462c-a9e2-19787178d145 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.612854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233394b-dc4a-462c-a9e2-19787178d145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.645300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0233394b-dc4a-462c-a9e2-19787178d145 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.646647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0233394b-dc4a-462c-a9e2-19787178d145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.651630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 780/1546] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/users => generated 288 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:41.652833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c923c-b2d7-4905-a527-43d463aa7d7c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.653148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c923c-b2d7-4905-a527-43d463aa7d7c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.653398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c923c-b2d7-4905-a527-43d463aa7d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.661276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 767/1547] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.661276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4946-feeb-43bf-a6f3-b18156c7f6b7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.661276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4946-feeb-43bf-a6f3-b18156c7f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.661276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4946-feeb-43bf-a6f3-b18156c7f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.680351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-242c923c-b2d7-4905-a527-43d463aa7d7c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.681675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-242c923c-b2d7-4905-a527-43d463aa7d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.681897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7b3c4946-feeb-43bf-a6f3-b18156c7f6b7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.683067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7b3c4946-feeb-43bf-a6f3-b18156c7f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.689530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 781/1548] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.694456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 768/1549] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.694456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50015b44-f61e-411f-9733-725f1e41638c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.694456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50015b44-f61e-411f-9733-725f1e41638c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.694456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50015b44-f61e-411f-9733-725f1e41638c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.699178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb854-aaaa-4334-8aac-aad65f66f968 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.699473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb854-aaaa-4334-8aac-aad65f66f968 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.699735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcb854-aaaa-4334-8aac-aad65f66f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.714514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-50015b44-f61e-411f-9733-725f1e41638c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.715741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-50015b44-f61e-411f-9733-725f1e41638c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.720029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f6dcb854-aaaa-4334-8aac-aad65f66f968 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.721228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f6dcb854-aaaa-4334-8aac-aad65f66f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.727433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 769/1550] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.727433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c856-4b84-45b9-a384-18904fda04be None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.727433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c856-4b84-45b9-a384-18904fda04be None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.727433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90c856-4b84-45b9-a384-18904fda04be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.737072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 782/1551] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.738042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcb854-aaaa-4334-8aac-aad65f66f968 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.748587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcb854-aaaa-4334-8aac-aad65f66f968 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.749656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1a90c856-4b84-45b9-a384-18904fda04be None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.750888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1a90c856-4b84-45b9-a384-18904fda04be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.753432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735e02-2cd3-4af3-bbe6-c22cab3a57d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.754029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735e02-2cd3-4af3-bbe6-c22cab3a57d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.754307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735e02-2cd3-4af3-bbe6-c22cab3a57d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.754589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735e02-2cd3-4af3-bbe6-c22cab3a57d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.755273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735e02-2cd3-4af3-bbe6-c22cab3a57d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.756907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22735e02-2cd3-4af3-bbe6-c22cab3a57d7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.759624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 770/1552] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.760810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5690-7fc6-441d-9fe5-d32b028e49c5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.761187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5690-7fc6-441d-9fe5-d32b028e49c5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.761456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd5690-7fc6-441d-9fe5-d32b028e49c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.775687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 783/1553] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:41.776970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735e02-2cd3-4af3-bbe6-c22cab3a57d7 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.781130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-43cd5690-7fc6-441d-9fe5-d32b028e49c5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.782333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-43cd5690-7fc6-441d-9fe5-d32b028e49c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.786469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735e02-2cd3-4af3-bbe6-c22cab3a57d7 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.790588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 771/1554] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.791536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.791831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78328f-1d0b-4745-a707-d970cce966c2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.792119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78328f-1d0b-4745-a707-d970cce966c2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.792231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.792419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78328f-1d0b-4745-a707-d970cce966c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.792534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.792688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.793410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:41.793764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.795427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.816446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 784/1555] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:41.816446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.816865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6f78328f-1d0b-4745-a707-d970cce966c2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.816865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6f78328f-1d0b-4745-a707-d970cce966c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.822525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7ee8c-9cdf-4dd9-a6c8-dbb799de2965 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.826790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 772/1556] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.826790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4817f-8a3a-4384-8c22-919fae2a39f8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.826790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4817f-8a3a-4384-8c22-919fae2a39f8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.826790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4817f-8a3a-4384-8c22-919fae2a39f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.827673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5054c4d-6897-4ca0-b785-07a529f03db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.828300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054c4d-6897-4ca0-b785-07a529f03db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.828572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054c4d-6897-4ca0-b785-07a529f03db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.828862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054c4d-6897-4ca0-b785-07a529f03db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.829539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5054c4d-6897-4ca0-b785-07a529f03db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:41.829841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5054c4d-6897-4ca0-b785-07a529f03db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.831399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5054c4d-6897-4ca0-b785-07a529f03db3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.843832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 785/1557] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:41.844738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0ee4817f-8a3a-4384-8c22-919fae2a39f8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.844968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d003a9b-e4fd-40c0-aa5f-bcb066756884 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.845283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d003a9b-e4fd-40c0-aa5f-bcb066756884 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.845513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d003a9b-e4fd-40c0-aa5f-bcb066756884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.845942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ee4817f-8a3a-4384-8c22-919fae2a39f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.857627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 773/1558] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.859133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c83ff-39cc-4009-a2a5-d54b023a9107 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.859516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c83ff-39cc-4009-a2a5-d54b023a9107 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.859788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c83ff-39cc-4009-a2a5-d54b023a9107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.866996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7d003a9b-e4fd-40c0-aa5f-bcb066756884 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.868202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7d003a9b-e4fd-40c0-aa5f-bcb066756884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.876173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 786/1559] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.876977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d003a9b-e4fd-40c0-aa5f-bcb066756884 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.880894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d73c83ff-39cc-4009-a2a5-d54b023a9107 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.882127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d73c83ff-39cc-4009-a2a5-d54b023a9107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:41.886074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d003a9b-e4fd-40c0-aa5f-bcb066756884 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.890361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 774/1560] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:41.890611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ec144-6cec-4c74-b9e4-658723eaa829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.891060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec144-6cec-4c74-b9e4-658723eaa829 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.891178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c83ff-39cc-4009-a2a5-d54b023a9107 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.891344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec144-6cec-4c74-b9e4-658723eaa829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.891596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ec144-6cec-4c74-b9e4-658723eaa829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.892234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ec144-6cec-4c74-b9e4-658723eaa829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.893862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ec144-6cec-4c74-b9e4-658723eaa829 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.901569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c83ff-39cc-4009-a2a5-d54b023a9107 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.908523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 787/1561] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:41.908673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.908801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ec144-6cec-4c74-b9e4-658723eaa829 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.908927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.908927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.908927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.908927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:41.908927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.909580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:18:41.909580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: warnings.warn(msg) Aug 31 05:18:41.909580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: Aug 31 05:18:41.910457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.916263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ec144-6cec-4c74-b9e4-658723eaa829 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.921114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181a340-bb79-4dc1-87aa-2da5d89b21cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.921719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181a340-bb79-4dc1-87aa-2da5d89b21cb admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.921992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181a340-bb79-4dc1-87aa-2da5d89b21cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.922257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181a340-bb79-4dc1-87aa-2da5d89b21cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.922498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 775/1562] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:41.923303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.925550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181a340-bb79-4dc1-87aa-2da5d89b21cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.926686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING py.warnings [None req-5181a340-bb79-4dc1-87aa-2da5d89b21cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:18:41.926686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: warnings.warn(msg) Aug 31 05:18:41.926686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: Aug 31 05:18:41.927865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181a340-bb79-4dc1-87aa-2da5d89b21cb admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.933257 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917bee-e7aa-4e20-93bb-0a58812164cc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.937911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:41.938502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.938780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.939038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.939676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:41.939975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:41.941602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:41.953867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 776/1563] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:41.954643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:41.961056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 788/1564] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:41.961056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a790e-a227-4a17-bf4e-da629dc1dd22 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:41.961056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a790e-a227-4a17-bf4e-da629dc1dd22 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:41.961056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a790e-a227-4a17-bf4e-da629dc1dd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:41.967153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe3f6a-9a9b-4e11-b552-12fdf2fb16a7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:41.979129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f51a790e-a227-4a17-bf4e-da629dc1dd22 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:41.980317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f51a790e-a227-4a17-bf4e-da629dc1dd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:42.010093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:42.010455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:42.026752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503b69c-4513-4293-b929-97a404a44eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.027488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503b69c-4513-4293-b929-97a404a44eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.027877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503b69c-4513-4293-b929-97a404a44eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.028241 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503b69c-4513-4293-b929-97a404a44eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.029005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503b69c-4513-4293-b929-97a404a44eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.031016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503b69c-4513-4293-b929-97a404a44eaa admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.044737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 789/1565] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:42.045619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a790e-a227-4a17-bf4e-da629dc1dd22 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.055192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a790e-a227-4a17-bf4e-da629dc1dd22 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.058670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 777/1566] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:41 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.059497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503b69c-4513-4293-b929-97a404a44eaa admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.059746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.060344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.060629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.060889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.061597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:42.062101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.063696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.082735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 790/1567] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:42.082735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.093163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968fbf8-df06-4058-9aa0-535e35f496ae admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.119897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503b69c-4513-4293-b929-97a404a44eaa admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.125368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.125964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.126504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.126504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.127122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:42.127421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.129170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.141266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 778/1568] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:42.142069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.152762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74619fa9-aacb-4569-a74a-897447b31166 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.153929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.154606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.154886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.155163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] PATH_INFO: `/v3/projects/e4d5c33eaa1e45618df214595397348a/users/b18cbec44ebd4bd38a352b5ebeb61a68/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.158027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2600d7-5b23-4df2-b9f9-e051497bd418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.158628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2600d7-5b23-4df2-b9f9-e051497bd418 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.158905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2600d7-5b23-4df2-b9f9-e051497bd418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.159176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2600d7-5b23-4df2-b9f9-e051497bd418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.159802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2600d7-5b23-4df2-b9f9-e051497bd418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.161737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2600d7-5b23-4df2-b9f9-e051497bd418 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.170041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d5c33eaa1e45618df214595397348a, user_id=b18cbec44ebd4bd38a352b5ebeb61a68, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.171125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING py.warnings [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:18:42.171125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: warnings.warn(msg) Aug 31 05:18:42.171125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: Aug 31 05:18:42.173051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.187394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 791/1569] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:42 2022] PUT /identity/v3/projects/e4d5c33eaa1e45618df214595397348a/users/b18cbec44ebd4bd38a352b5ebeb61a68/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:42.188180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.191823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 779/1570] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.192743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2600d7-5b23-4df2-b9f9-e051497bd418 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.250892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0913-d9d3-45c5-8a3e-aada8b92e121 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.253921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2600d7-5b23-4df2-b9f9-e051497bd418 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.255852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2598f-e5b6-4586-8dd7-7375f2319d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.256457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2598f-e5b6-4586-8dd7-7375f2319d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.256731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2598f-e5b6-4586-8dd7-7375f2319d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.256996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2598f-e5b6-4586-8dd7-7375f2319d6d admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.257881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2598f-e5b6-4586-8dd7-7375f2319d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.258786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652055b5-a614-4173-84df-77fea09c57af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.259399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652055b5-a614-4173-84df-77fea09c57af admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.259681 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652055b5-a614-4173-84df-77fea09c57af admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.259777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2598f-e5b6-4586-8dd7-7375f2319d6d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.259952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652055b5-a614-4173-84df-77fea09c57af admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.260669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652055b5-a614-4173-84df-77fea09c57af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.262534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652055b5-a614-4173-84df-77fea09c57af admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.285632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 792/1571] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.286281 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2598f-e5b6-4586-8dd7-7375f2319d6d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.296181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 780/1572] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.296181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652055b5-a614-4173-84df-77fea09c57af admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.298982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2598f-e5b6-4586-8dd7-7375f2319d6d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.326111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:42.330363 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:42.357893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.358509 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.358789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.359057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.359705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:42.360005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.361624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.361994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652055b5-a614-4173-84df-77fea09c57af admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.366817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.367633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.367914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.368202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.368826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.369873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:18:42.369873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: warnings.warn(msg) Aug 31 05:18:42.369873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: Aug 31 05:18:42.371052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.373894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 793/1573] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:42.374674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.386698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eca46-2f79-4605-ae8b-f2c59f6a204e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.391389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318f57f-1961-4115-a76e-ca1640a47492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.391982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318f57f-1961-4115-a76e-ca1640a47492 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.392258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318f57f-1961-4115-a76e-ca1640a47492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.392528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318f57f-1961-4115-a76e-ca1640a47492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.393182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318f57f-1961-4115-a76e-ca1640a47492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.395053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318f57f-1961-4115-a76e-ca1640a47492 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.400263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 781/1574] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.400263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.409179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab32aa-3703-44b2-83ef-e6555a03dffb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.415219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82063aaf-b941-4359-934b-52ee0cd715bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.415832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82063aaf-b941-4359-934b-52ee0cd715bb admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.416168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82063aaf-b941-4359-934b-52ee0cd715bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.416386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82063aaf-b941-4359-934b-52ee0cd715bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.417017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82063aaf-b941-4359-934b-52ee0cd715bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.418988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82063aaf-b941-4359-934b-52ee0cd715bb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.428919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 794/1575] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.428919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e193a-3901-4a7e-8d95-4782853b8dda None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.428919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e193a-3901-4a7e-8d95-4782853b8dda None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.428919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e193a-3901-4a7e-8d95-4782853b8dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.447076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-369e193a-3901-4a7e-8d95-4782853b8dda None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:42.447576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 782/1576] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.448388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82063aaf-b941-4359-934b-52ee0cd715bb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.451880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-369e193a-3901-4a7e-8d95-4782853b8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:42.510395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82063aaf-b941-4359-934b-52ee0cd715bb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.512266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 795/1577] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:42.513153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e193a-3901-4a7e-8d95-4782853b8dda None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.518082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaeddd-d453-4bf3-898f-89a7a62445f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.518732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaeddd-d453-4bf3-898f-89a7a62445f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.519039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaeddd-d453-4bf3-898f-89a7a62445f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.519317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaeddd-d453-4bf3-898f-89a7a62445f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.520040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaeddd-d453-4bf3-898f-89a7a62445f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.522005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaeddd-d453-4bf3-898f-89a7a62445f7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.523450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e193a-3901-4a7e-8d95-4782853b8dda None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.528912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47b5be-94c1-46b9-bbb0-b7987a704f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.529547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47b5be-94c1-46b9-bbb0-b7987a704f77 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.529829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47b5be-94c1-46b9-bbb0-b7987a704f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.530213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47b5be-94c1-46b9-bbb0-b7987a704f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.530866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47b5be-94c1-46b9-bbb0-b7987a704f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.532451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47b5be-94c1-46b9-bbb0-b7987a704f77 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.547813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 796/1578] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.547813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47b5be-94c1-46b9-bbb0-b7987a704f77 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.548111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 783/1579] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.548111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaeddd-d453-4bf3-898f-89a7a62445f7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.558817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaeddd-d453-4bf3-898f-89a7a62445f7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.558982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47b5be-94c1-46b9-bbb0-b7987a704f77 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.563601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5bbc0-df38-4848-af8a-d18172c9c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.563790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb34c-f6e1-42c4-8506-6e664c25dbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.564197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5bbc0-df38-4848-af8a-d18172c9c14a admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.564480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb34c-f6e1-42c4-8506-6e664c25dbbe admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.564590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5bbc0-df38-4848-af8a-d18172c9c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.564756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5bbc0-df38-4848-af8a-d18172c9c14a admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.564961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb34c-f6e1-42c4-8506-6e664c25dbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.565326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb34c-f6e1-42c4-8506-6e664c25dbbe admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.565427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5bbc0-df38-4848-af8a-d18172c9c14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.566074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb34c-f6e1-42c4-8506-6e664c25dbbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.567314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5bbc0-df38-4848-af8a-d18172c9c14a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.568101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb34c-f6e1-42c4-8506-6e664c25dbbe admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.594184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 797/1580] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.594184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb34c-f6e1-42c4-8506-6e664c25dbbe admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.598107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 784/1581] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.598107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5bbc0-df38-4848-af8a-d18172c9c14a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.603483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb34c-f6e1-42c4-8506-6e664c25dbbe admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.663566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c38ba-7cff-4cc8-ae95-920b1a4a5b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.664213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c38ba-7cff-4cc8-ae95-920b1a4a5b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.664463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c38ba-7cff-4cc8-ae95-920b1a4a5b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.664743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c38ba-7cff-4cc8-ae95-920b1a4a5b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.665468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c38ba-7cff-4cc8-ae95-920b1a4a5b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.666414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5bbc0-df38-4848-af8a-d18172c9c14a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.667058 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c38ba-7cff-4cc8-ae95-920b1a4a5b84 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.671117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.671726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.672003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.672246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.672870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.674905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.677450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 798/1582] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.678114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c38ba-7cff-4cc8-ae95-920b1a4a5b84 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.684097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:42.688863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c38ba-7cff-4cc8-ae95-920b1a4a5b84 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.694306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62484219-d5e9-4fe9-8607-b09d23f06a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.695022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62484219-d5e9-4fe9-8607-b09d23f06a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.695629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62484219-d5e9-4fe9-8607-b09d23f06a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.695629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62484219-d5e9-4fe9-8607-b09d23f06a6c admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.696206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62484219-d5e9-4fe9-8607-b09d23f06a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.698144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 785/1583] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.698255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62484219-d5e9-4fe9-8607-b09d23f06a6c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.699043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.700622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:42.713617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:42.728071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 799/1584] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/users => generated 282 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.729373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62484219-d5e9-4fe9-8607-b09d23f06a6c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.739379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62484219-d5e9-4fe9-8607-b09d23f06a6c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.745289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6a84e-3ae7-463b-9740-2f2d9fdfc74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.745891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6a84e-3ae7-463b-9740-2f2d9fdfc74f admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.746167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6a84e-3ae7-463b-9740-2f2d9fdfc74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.746432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6a84e-3ae7-463b-9740-2f2d9fdfc74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.747068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6a84e-3ae7-463b-9740-2f2d9fdfc74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.748649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6a84e-3ae7-463b-9740-2f2d9fdfc74f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.759330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 800/1585] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.760136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6a84e-3ae7-463b-9740-2f2d9fdfc74f admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.765867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36ed6c-c4d0-4d5f-8240-c1c0f6eadf14 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.769483 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e333c12-10dd-4888-bc57-6a0e34ed7b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.770124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e333c12-10dd-4888-bc57-6a0e34ed7b87 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.770397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e333c12-10dd-4888-bc57-6a0e34ed7b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.770502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6a84e-3ae7-463b-9740-2f2d9fdfc74f admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.770662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e333c12-10dd-4888-bc57-6a0e34ed7b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.775648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ddeb-d17a-4144-a720-fe19a71693b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.776223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ddeb-d17a-4144-a720-fe19a71693b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.776520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ddeb-d17a-4144-a720-fe19a71693b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.776783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ddeb-d17a-4144-a720-fe19a71693b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.777629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4ddeb-d17a-4144-a720-fe19a71693b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.779299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4ddeb-d17a-4144-a720-fe19a71693b8 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.780307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e333c12-10dd-4888-bc57-6a0e34ed7b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.781745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e333c12-10dd-4888-bc57-6a0e34ed7b87 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.789881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 801/1586] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.790673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ddeb-d17a-4144-a720-fe19a71693b8 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.794164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 786/1587] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:42.794950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e333c12-10dd-4888-bc57-6a0e34ed7b87 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.799991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ddeb-d17a-4144-a720-fe19a71693b8 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.803850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e333c12-10dd-4888-bc57-6a0e34ed7b87 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.804760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42336f9-96dc-41c6-94f9-9ae5d01c31ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.805487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42336f9-96dc-41c6-94f9-9ae5d01c31ba admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.805767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42336f9-96dc-41c6-94f9-9ae5d01c31ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.806036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42336f9-96dc-41c6-94f9-9ae5d01c31ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.806692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42336f9-96dc-41c6-94f9-9ae5d01c31ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.808262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42336f9-96dc-41c6-94f9-9ae5d01c31ba admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.809435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b4ad8-2355-4607-a341-7d9a2b66fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.810032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4ad8-2355-4607-a341-7d9a2b66fd36 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.810306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4ad8-2355-4607-a341-7d9a2b66fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.811215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4ad8-2355-4607-a341-7d9a2b66fd36 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.811879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b4ad8-2355-4607-a341-7d9a2b66fd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.813787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b4ad8-2355-4607-a341-7d9a2b66fd36 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.822541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 802/1588] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.823407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42336f9-96dc-41c6-94f9-9ae5d01c31ba admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.834332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42336f9-96dc-41c6-94f9-9ae5d01c31ba admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.840400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 787/1589] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:42 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:42.841119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b4ad8-2355-4607-a341-7d9a2b66fd36 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.844516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8098-699b-43a0-a39c-183aff0b4bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.845157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8098-699b-43a0-a39c-183aff0b4bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.845444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8098-699b-43a0-a39c-183aff0b4bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.845716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8098-699b-43a0-a39c-183aff0b4bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.846346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8098-699b-43a0-a39c-183aff0b4bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.847927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8098-699b-43a0-a39c-183aff0b4bd3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.852431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b4ad8-2355-4607-a341-7d9a2b66fd36 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.857628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a4c1-3e7c-45b8-b281-749feaca33d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.858314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a4c1-3e7c-45b8-b281-749feaca33d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.858653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a4c1-3e7c-45b8-b281-749feaca33d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.858984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791a4c1-3e7c-45b8-b281-749feaca33d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.859810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791a4c1-3e7c-45b8-b281-749feaca33d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.864774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 803/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.864940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791a4c1-3e7c-45b8-b281-749feaca33d2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.865051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8098-699b-43a0-a39c-183aff0b4bd3 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.876884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 788/1591] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.876884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a4c1-3e7c-45b8-b281-749feaca33d2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.877215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8098-699b-43a0-a39c-183aff0b4bd3 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.882975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7bca-45bb-4a70-8a50-0f0dce5e4090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.883704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7bca-45bb-4a70-8a50-0f0dce5e4090 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.884829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7bca-45bb-4a70-8a50-0f0dce5e4090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.884829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7bca-45bb-4a70-8a50-0f0dce5e4090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.885450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7bca-45bb-4a70-8a50-0f0dce5e4090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.887240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b7bca-45bb-4a70-8a50-0f0dce5e4090 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.887902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791a4c1-3e7c-45b8-b281-749feaca33d2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.893335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac70cb-98b7-4fbe-a709-5bd42bf561d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.894509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac70cb-98b7-4fbe-a709-5bd42bf561d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.894509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac70cb-98b7-4fbe-a709-5bd42bf561d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.894860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac70cb-98b7-4fbe-a709-5bd42bf561d6 admin admin] PATH_INFO: `/v3/projects/93b12b25252542f4bbd58d6b048fade8/users/7539b3d3269b45e8a57afb7f5afc6f2d/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.901006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 804/1592] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.901793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7bca-45bb-4a70-8a50-0f0dce5e4090 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.913913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7bca-45bb-4a70-8a50-0f0dce5e4090 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:42.915551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac70cb-98b7-4fbe-a709-5bd42bf561d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b12b25252542f4bbd58d6b048fade8, user_id=7539b3d3269b45e8a57afb7f5afc6f2d, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.918296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac70cb-98b7-4fbe-a709-5bd42bf561d6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.919568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb1029-b1f8-4e48-a120-8e165b1ffba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:42.920419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb1029-b1f8-4e48-a120-8e165b1ffba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:42.920773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb1029-b1f8-4e48-a120-8e165b1ffba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:42.921119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb1029-b1f8-4e48-a120-8e165b1ffba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:42.921948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb1029-b1f8-4e48-a120-8e165b1ffba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:42.923645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb1029-b1f8-4e48-a120-8e165b1ffba3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:42.933664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 789/1593] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:42 2022] PUT /identity/v3/projects/93b12b25252542f4bbd58d6b048fade8/users/7539b3d3269b45e8a57afb7f5afc6f2d/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:42.934851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 805/1594] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:42.935699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb1029-b1f8-4e48-a120-8e165b1ffba3 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.938099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac70cb-98b7-4fbe-a709-5bd42bf561d6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:42.947405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb1029-b1f8-4e48-a120-8e165b1ffba3 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.019700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0112-f2a2-4cb7-9147-a3aabfaa1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.020322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0112-f2a2-4cb7-9147-a3aabfaa1cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.020668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0112-f2a2-4cb7-9147-a3aabfaa1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.020997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0112-f2a2-4cb7-9147-a3aabfaa1cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.021622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e0112-f2a2-4cb7-9147-a3aabfaa1cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.023500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e0112-f2a2-4cb7-9147-a3aabfaa1cbe admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.032954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac70cb-98b7-4fbe-a709-5bd42bf561d6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.040600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6814e-6f5a-4d4d-81d2-bfe1a2f4f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.042198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6814e-6f5a-4d4d-81d2-bfe1a2f4f8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.042198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6814e-6f5a-4d4d-81d2-bfe1a2f4f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.042198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6814e-6f5a-4d4d-81d2-bfe1a2f4f8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.042641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 806/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:43.042641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0112-f2a2-4cb7-9147-a3aabfaa1cbe admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.045551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6814e-6f5a-4d4d-81d2-bfe1a2f4f8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.047184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6814e-6f5a-4d4d-81d2-bfe1a2f4f8ba admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.054036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0112-f2a2-4cb7-9147-a3aabfaa1cbe admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.061344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 790/1596] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:43.061344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6814e-6f5a-4d4d-81d2-bfe1a2f4f8ba admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.062547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed85d8d-bb60-49a1-8219-77f01c844633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.063230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed85d8d-bb60-49a1-8219-77f01c844633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.063508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed85d8d-bb60-49a1-8219-77f01c844633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.063873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed85d8d-bb60-49a1-8219-77f01c844633 admin admin] PATH_INFO: `/v3/projects/1c174bb7b7e540b9b05832c44cae3178/users/2f0c7305f2904f9cb68d17bc3e3f5582/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.068996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6814e-6f5a-4d4d-81d2-bfe1a2f4f8ba admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.074280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f013975-e5db-4764-9bfb-9c0f257eb3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.074900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013975-e5db-4764-9bfb-9c0f257eb3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.075182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013975-e5db-4764-9bfb-9c0f257eb3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.075587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013975-e5db-4764-9bfb-9c0f257eb3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.076284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f013975-e5db-4764-9bfb-9c0f257eb3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.078017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f013975-e5db-4764-9bfb-9c0f257eb3d8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.080722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed85d8d-bb60-49a1-8219-77f01c844633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c174bb7b7e540b9b05832c44cae3178, user_id=2f0c7305f2904f9cb68d17bc3e3f5582, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.083420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed85d8d-bb60-49a1-8219-77f01c844633 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.089326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 791/1597] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:43.090366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f013975-e5db-4764-9bfb-9c0f257eb3d8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.101465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 807/1598] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:43 2022] PUT /identity/v3/projects/1c174bb7b7e540b9b05832c44cae3178/users/2f0c7305f2904f9cb68d17bc3e3f5582/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:43.103038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe27ac-3fe7-4cd8-920e-afcce25f054a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.103198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f013975-e5db-4764-9bfb-9c0f257eb3d8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.103614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe27ac-3fe7-4cd8-920e-afcce25f054a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.104037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe27ac-3fe7-4cd8-920e-afcce25f054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.133645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-63fe27ac-3fe7-4cd8-920e-afcce25f054a None None] MFA Rules not processed for user `7539b3d3269b45e8a57afb7f5afc6f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:43.133886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:43.135160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-63fe27ac-3fe7-4cd8-920e-afcce25f054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:43.180939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bbe96-1635-4c8a-865b-963935234b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.181675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bbe96-1635-4c8a-865b-963935234b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.181997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bbe96-1635-4c8a-865b-963935234b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.182387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bbe96-1635-4c8a-865b-963935234b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.182959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bbe96-1635-4c8a-865b-963935234b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.184713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bbe96-1635-4c8a-865b-963935234b95 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.195521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 792/1599] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:43.196352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bbe96-1635-4c8a-865b-963935234b95 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.206768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bbe96-1635-4c8a-865b-963935234b95 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.211672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:43.211855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b815-a37d-4f13-8dbd-1bcb994a72b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.212878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b815-a37d-4f13-8dbd-1bcb994a72b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.213262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b815-a37d-4f13-8dbd-1bcb994a72b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.213824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b815-a37d-4f13-8dbd-1bcb994a72b5 admin admin] PATH_INFO: `/v3/projects/c167aad0619d48afa3b3dc13da18213c/users/3a0302dc62c04e839db94cb2a630b5f4/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.232164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 808/1600] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:43.233875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe27ac-3fe7-4cd8-920e-afcce25f054a None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.235077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b815-a37d-4f13-8dbd-1bcb994a72b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c167aad0619d48afa3b3dc13da18213c, user_id=3a0302dc62c04e839db94cb2a630b5f4, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.239820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b815-a37d-4f13-8dbd-1bcb994a72b5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.251796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe27ac-3fe7-4cd8-920e-afcce25f054a None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.256709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 793/1601] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:43 2022] PUT /identity/v3/projects/c167aad0619d48afa3b3dc13da18213c/users/3a0302dc62c04e839db94cb2a630b5f4/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:43.257765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b815-a37d-4f13-8dbd-1bcb994a72b5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.328401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81dab5-c1dd-486b-b1c3-915d709aa0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.329035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dab5-c1dd-486b-b1c3-915d709aa0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.329367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dab5-c1dd-486b-b1c3-915d709aa0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.329714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81dab5-c1dd-486b-b1c3-915d709aa0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.330374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81dab5-c1dd-486b-b1c3-915d709aa0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.332040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81dab5-c1dd-486b-b1c3-915d709aa0c4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 809/1602] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:43.343714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81dab5-c1dd-486b-b1c3-915d709aa0c4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.353275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b815-a37d-4f13-8dbd-1bcb994a72b5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.356884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81dab5-c1dd-486b-b1c3-915d709aa0c4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.358976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767596fb-73d1-48a6-bffb-158de89e51ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.359697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767596fb-73d1-48a6-bffb-158de89e51ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.359985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767596fb-73d1-48a6-bffb-158de89e51ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.360286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767596fb-73d1-48a6-bffb-158de89e51ec admin admin] PATH_INFO: `/v3/projects/856381cca9134a25a8954d0751ff7f38/users/9032773d56f84e7c889b189b21803c3b/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.362408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfa653-7c07-45a7-ab2a-725379fed530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.363279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfa653-7c07-45a7-ab2a-725379fed530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.363586 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfa653-7c07-45a7-ab2a-725379fed530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.363857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfa653-7c07-45a7-ab2a-725379fed530 admin admin] PATH_INFO: `/v3/projects/ad9a6ee52ad742e0a0273f24af7eb05b/users/e9090f91f5794af6ade9585073fe0005/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.377392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767596fb-73d1-48a6-bffb-158de89e51ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=856381cca9134a25a8954d0751ff7f38, user_id=9032773d56f84e7c889b189b21803c3b, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.380053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767596fb-73d1-48a6-bffb-158de89e51ec admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.380533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfa653-7c07-45a7-ab2a-725379fed530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9a6ee52ad742e0a0273f24af7eb05b, user_id=e9090f91f5794af6ade9585073fe0005, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.384005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfa653-7c07-45a7-ab2a-725379fed530 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.397456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 794/1603] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:43 2022] PUT /identity/v3/projects/856381cca9134a25a8954d0751ff7f38/users/9032773d56f84e7c889b189b21803c3b/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:43.399154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 810/1604] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:43 2022] PUT /identity/v3/projects/ad9a6ee52ad742e0a0273f24af7eb05b/users/e9090f91f5794af6ade9585073fe0005/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:43.399857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75c206-2006-4890-9862-524cbb39a0ae None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.400269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfa653-7c07-45a7-ab2a-725379fed530 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.400482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75c206-2006-4890-9862-524cbb39a0ae None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.401112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75c206-2006-4890-9862-524cbb39a0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.432384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-af75c206-2006-4890-9862-524cbb39a0ae None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:43.433640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-af75c206-2006-4890-9862-524cbb39a0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:43.486658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfa653-7c07-45a7-ab2a-725379fed530 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.493772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d08c1c-41de-4ee4-867a-4e57f61dd457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.494466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d08c1c-41de-4ee4-867a-4e57f61dd457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.494749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d08c1c-41de-4ee4-867a-4e57f61dd457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.495692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d08c1c-41de-4ee4-867a-4e57f61dd457 admin admin] PATH_INFO: `/v3/projects/a973fd9df19c4761bce300e16bf64ac6/users/7b61afb3d3f94c699fc5a007433e4d08/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.505353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 795/1605] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:43.508747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24eeba-dd20-42e6-bd07-418ba5603f95 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.508747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24eeba-dd20-42e6-bd07-418ba5603f95 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.508747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24eeba-dd20-42e6-bd07-418ba5603f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.516018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d08c1c-41de-4ee4-867a-4e57f61dd457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a973fd9df19c4761bce300e16bf64ac6, user_id=7b61afb3d3f94c699fc5a007433e4d08, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.519125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d08c1c-41de-4ee4-867a-4e57f61dd457 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.536137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 811/1606] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:43 2022] PUT /identity/v3/projects/a973fd9df19c4761bce300e16bf64ac6/users/7b61afb3d3f94c699fc5a007433e4d08/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:43.538197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42d9b-05fb-452f-954c-a46929432b31 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.538197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42d9b-05fb-452f-954c-a46929432b31 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.538504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c42d9b-05fb-452f-954c-a46929432b31 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.541052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 812/1607] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 31 05:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:18:43.541837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42d9b-05fb-452f-954c-a46929432b31 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.545787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9a24eeba-dd20-42e6-bd07-418ba5603f95 None None] MFA Rules not processed for user `3a0302dc62c04e839db94cb2a630b5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:43.547130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9a24eeba-dd20-42e6-bd07-418ba5603f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:43.560420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:43.613827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:43.647792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c42d9b-05fb-452f-954c-a46929432b31 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.657514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a012c4-e587-4aea-935c-4fbb6e6a3dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.658491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a012c4-e587-4aea-935c-4fbb6e6a3dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.659163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a012c4-e587-4aea-935c-4fbb6e6a3dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.659510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a012c4-e587-4aea-935c-4fbb6e6a3dab admin admin] PATH_INFO: `/v3/projects/58d905af768f4b92bc98a288ebce5d4b/users/359f2e7aebf74167bf87af802bccdbbb/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.661682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 796/1608] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:43.663213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ad28-d30d-4594-9538-7f2293cc2a5e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.663579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ad28-d30d-4594-9538-7f2293cc2a5e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.663887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3ad28-d30d-4594-9538-7f2293cc2a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.685098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0ed3ad28-d30d-4594-9538-7f2293cc2a5e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:43.686579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ed3ad28-d30d-4594-9538-7f2293cc2a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:43.691841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a012c4-e587-4aea-935c-4fbb6e6a3dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d905af768f4b92bc98a288ebce5d4b, user_id=359f2e7aebf74167bf87af802bccdbbb, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.695989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 797/1609] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:43.697332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172229-2741-45b2-a034-ca6b8538937e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.697612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172229-2741-45b2-a034-ca6b8538937e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.697960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172229-2741-45b2-a034-ca6b8538937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.702986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a012c4-e587-4aea-935c-4fbb6e6a3dab admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.725716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 813/1610] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:43 2022] PUT /identity/v3/projects/58d905af768f4b92bc98a288ebce5d4b/users/359f2e7aebf74167bf87af802bccdbbb/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:43.726636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a012c4-e587-4aea-935c-4fbb6e6a3dab admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.734568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-46172229-2741-45b2-a034-ca6b8538937e None None] MFA Rules not processed for user `e9090f91f5794af6ade9585073fe0005`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:43.735970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-46172229-2741-45b2-a034-ca6b8538937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:43.784610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a012c4-e587-4aea-935c-4fbb6e6a3dab admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:43.788331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a83c7-6971-43f0-bc17-95ca2f1f3926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:43.788998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a83c7-6971-43f0-bc17-95ca2f1f3926 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.789379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a83c7-6971-43f0-bc17-95ca2f1f3926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.789645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a83c7-6971-43f0-bc17-95ca2f1f3926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.835564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 798/1611] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:43.838683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574b36-0de0-4ee7-a9bb-b538ae5aa50a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.839282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574b36-0de0-4ee7-a9bb-b538ae5aa50a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.840965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574b36-0de0-4ee7-a9bb-b538ae5aa50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.877462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a83c7-6971-43f0-bc17-95ca2f1f3926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:43.879792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a83c7-6971-43f0-bc17-95ca2f1f3926 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:43.894654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-24574b36-0de0-4ee7-a9bb-b538ae5aa50a None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:43.894920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 814/1612] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:43.896121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-24574b36-0de0-4ee7-a9bb-b538ae5aa50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:43.896262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b60f-fd84-4e2a-b021-d84ebed779b9 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:43.896675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b60f-fd84-4e2a-b021-d84ebed779b9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:43.896986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56b60f-fd84-4e2a-b021-d84ebed779b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:43.932236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9c56b60f-fd84-4e2a-b021-d84ebed779b9 None None] MFA Rules not processed for user `7b61afb3d3f94c699fc5a007433e4d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:43.933569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9c56b60f-fd84-4e2a-b021-d84ebed779b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:43.981764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 799/1613] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 31 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:43.983257 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574b36-0de0-4ee7-a9bb-b538ae5aa50a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:43.997281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574b36-0de0-4ee7-a9bb-b538ae5aa50a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.004560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f457c8-eb08-4777-8762-5860954bca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.004998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f457c8-eb08-4777-8762-5860954bca19 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.005398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f457c8-eb08-4777-8762-5860954bca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.005766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f457c8-eb08-4777-8762-5860954bca19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.006502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f457c8-eb08-4777-8762-5860954bca19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.009186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f457c8-eb08-4777-8762-5860954bca19 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.014170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 815/1614] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:44.015164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56b60f-fd84-4e2a-b021-d84ebed779b9 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.029902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:44.037341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56b60f-fd84-4e2a-b021-d84ebed779b9 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.042241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed8f1-a821-48a6-b645-9879034d56ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.043193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed8f1-a821-48a6-b645-9879034d56ab service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.043531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed8f1-a821-48a6-b645-9879034d56ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.043915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed8f1-a821-48a6-b645-9879034d56ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.053218 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:44.055552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 800/1615] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:43 2022] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:44.056984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c08a-4e65-41c2-8901-8a4af008225b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.057298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c08a-4e65-41c2-8901-8a4af008225b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.057572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854c08a-4e65-41c2-8901-8a4af008225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.059617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbed8f1-a821-48a6-b645-9879034d56ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.061988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbed8f1-a821-48a6-b645-9879034d56ab service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.077560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 816/1616] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:44.078788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed8f1-a821-48a6-b645-9879034d56ab service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.081024 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9854c08a-4e65-41c2-8901-8a4af008225b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:44.082921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9854c08a-4e65-41c2-8901-8a4af008225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:44.092210 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed8f1-a821-48a6-b645-9879034d56ab service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.194833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337603c9-9a7c-45ed-9176-912097b8afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.195965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337603c9-9a7c-45ed-9176-912097b8afce admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.196554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337603c9-9a7c-45ed-9176-912097b8afce admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.197054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337603c9-9a7c-45ed-9176-912097b8afce admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.198061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337603c9-9a7c-45ed-9176-912097b8afce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.200464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337603c9-9a7c-45ed-9176-912097b8afce admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.221658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 801/1617] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:44.222987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c08a-4e65-41c2-8901-8a4af008225b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.240716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 817/1618] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:44 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:44.242895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337603c9-9a7c-45ed-9176-912097b8afce admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.375822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854c08a-4e65-41c2-8901-8a4af008225b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.391707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337603c9-9a7c-45ed-9176-912097b8afce admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.403700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a21ff-efca-4098-95eb-9d7e84e311d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.404348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a21ff-efca-4098-95eb-9d7e84e311d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.404631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a21ff-efca-4098-95eb-9d7e84e311d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.404897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a21ff-efca-4098-95eb-9d7e84e311d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.405600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a21ff-efca-4098-95eb-9d7e84e311d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.407510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a21ff-efca-4098-95eb-9d7e84e311d9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.469074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 818/1619] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:44 2022] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:44.470030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a21ff-efca-4098-95eb-9d7e84e311d9 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.476356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f88294-3b5d-44a0-a938-377081897bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.477169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f88294-3b5d-44a0-a938-377081897bb2 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.477606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f88294-3b5d-44a0-a938-377081897bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.478333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f88294-3b5d-44a0-a938-377081897bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.522382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:44.564810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f88294-3b5d-44a0-a938-377081897bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.566849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f88294-3b5d-44a0-a938-377081897bb2 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.578769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 802/1620] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:44.579546 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f88294-3b5d-44a0-a938-377081897bb2 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.591913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f88294-3b5d-44a0-a938-377081897bb2 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.627396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a21ff-efca-4098-95eb-9d7e84e311d9 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.643057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428342-9899-4a17-814a-85853c3fdba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.643692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428342-9899-4a17-814a-85853c3fdba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.646223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428342-9899-4a17-814a-85853c3fdba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.646411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428342-9899-4a17-814a-85853c3fdba8 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.648727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36428342-9899-4a17-814a-85853c3fdba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.656959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36428342-9899-4a17-814a-85853c3fdba8 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.698182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c28e8-5c84-4fac-af65-2d8055a6ddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.700524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c28e8-5c84-4fac-af65-2d8055a6ddba admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.701174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c28e8-5c84-4fac-af65-2d8055a6ddba admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.701463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c28e8-5c84-4fac-af65-2d8055a6ddba admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.702188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:44.705274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c28e8-5c84-4fac-af65-2d8055a6ddba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.714988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c28e8-5c84-4fac-af65-2d8055a6ddba admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.721304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 819/1621] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:44 2022] POST /identity/v3/users => generated 309 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:44.722147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428342-9899-4a17-814a-85853c3fdba8 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.774709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 803/1622] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:44 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:44.775688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c28e8-5c84-4fac-af65-2d8055a6ddba admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.806285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c28e8-5c84-4fac-af65-2d8055a6ddba admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.830065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac3ea-2ae1-4cc9-acb6-fb6884354b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.830713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac3ea-2ae1-4cc9-acb6-fb6884354b3b admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.830990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac3ea-2ae1-4cc9-acb6-fb6884354b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.831260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac3ea-2ae1-4cc9-acb6-fb6884354b3b admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.831898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaac3ea-2ae1-4cc9-acb6-fb6884354b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.833877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaac3ea-2ae1-4cc9-acb6-fb6884354b3b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.925867 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428342-9899-4a17-814a-85853c3fdba8 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.925867 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6a32d-704f-4a0f-9d45-a371784e1f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.925867 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6a32d-704f-4a0f-9d45-a371784e1f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.925867 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6a32d-704f-4a0f-9d45-a371784e1f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.926607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6a32d-704f-4a0f-9d45-a371784e1f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.926841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 804/1623] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:44 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:44.926841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac3ea-2ae1-4cc9-acb6-fb6884354b3b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.927033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6a32d-704f-4a0f-9d45-a371784e1f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.928877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6a32d-704f-4a0f-9d45-a371784e1f85 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.929563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac3ea-2ae1-4cc9-acb6-fb6884354b3b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.938040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31345b5-f0cc-4b94-8e9d-fdcb3a19ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.938918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31345b5-f0cc-4b94-8e9d-fdcb3a19ab70 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.939289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31345b5-f0cc-4b94-8e9d-fdcb3a19ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.939660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31345b5-f0cc-4b94-8e9d-fdcb3a19ab70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.941135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31345b5-f0cc-4b94-8e9d-fdcb3a19ab70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.941291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 820/1624] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:44.942077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6a32d-704f-4a0f-9d45-a371784e1f85 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.943279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31345b5-f0cc-4b94-8e9d-fdcb3a19ab70 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.951890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6a32d-704f-4a0f-9d45-a371784e1f85 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:44.960693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c1bff-5590-4cf9-aeb4-17a048118d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:44.961442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1bff-5590-4cf9-aeb4-17a048118d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.961723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1bff-5590-4cf9-aeb4-17a048118d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.961982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1bff-5590-4cf9-aeb4-17a048118d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.962634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c1bff-5590-4cf9-aeb4-17a048118d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:44.964241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c1bff-5590-4cf9-aeb4-17a048118d8a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:44.977937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 805/1625] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:44.981469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31345b5-f0cc-4b94-8e9d-fdcb3a19ab70 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:44.986445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 821/1626] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:44.991039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacf8e-ee99-4b87-b2e1-b408a42f840c None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:44.991384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacf8e-ee99-4b87-b2e1-b408a42f840c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:44.991753 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dacf8e-ee99-4b87-b2e1-b408a42f840c None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:44.993790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 822/1627] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 31 05:18:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:18:44.994582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dacf8e-ee99-4b87-b2e1-b408a42f840c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.003530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31345b5-f0cc-4b94-8e9d-fdcb3a19ab70 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.009597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9843c32-67fb-4e8c-a0c3-f75f914a0252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.010279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9843c32-67fb-4e8c-a0c3-f75f914a0252 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.010737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9843c32-67fb-4e8c-a0c3-f75f914a0252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.011017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9843c32-67fb-4e8c-a0c3-f75f914a0252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.011836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9843c32-67fb-4e8c-a0c3-f75f914a0252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.012709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dacf8e-ee99-4b87-b2e1-b408a42f840c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.013675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9843c32-67fb-4e8c-a0c3-f75f914a0252 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.017991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f5b3-66e9-40fb-bd11-95cd31fa382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.018886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f5b3-66e9-40fb-bd11-95cd31fa382a admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.019315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f5b3-66e9-40fb-bd11-95cd31fa382a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.020209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f5b3-66e9-40fb-bd11-95cd31fa382a admin admin] PATH_INFO: `/v3/projects/7c4b24c0998244188eff07beb44ae84c/users/eba34ce828244ffdbb1e9c95b39ed9da/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.026400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 806/1628] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:45.031219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9843c32-67fb-4e8c-a0c3-f75f914a0252 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.042663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036f5b3-66e9-40fb-bd11-95cd31fa382a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4b24c0998244188eff07beb44ae84c, user_id=eba34ce828244ffdbb1e9c95b39ed9da, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.045827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036f5b3-66e9-40fb-bd11-95cd31fa382a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.048635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9843c32-67fb-4e8c-a0c3-f75f914a0252 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.054355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a774b-2006-4a02-8dcf-84c93c9f9d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.055147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a774b-2006-4a02-8dcf-84c93c9f9d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.055508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a774b-2006-4a02-8dcf-84c93c9f9d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.055777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a774b-2006-4a02-8dcf-84c93c9f9d4a admin admin] PATH_INFO: `/v3/projects/577c2658460f4404b7281581975e7543/users/b77b231860ff4d8289dd71a746c27a45/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.064725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 823/1629] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:44 2022] PUT /identity/v3/projects/7c4b24c0998244188eff07beb44ae84c/users/eba34ce828244ffdbb1e9c95b39ed9da/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:45.066477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f1c3-6ddd-4c5b-a0c5-903582aa287b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.067352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f1c3-6ddd-4c5b-a0c5-903582aa287b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.067786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79f1c3-6ddd-4c5b-a0c5-903582aa287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.076355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a774b-2006-4a02-8dcf-84c93c9f9d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=577c2658460f4404b7281581975e7543, user_id=b77b231860ff4d8289dd71a746c27a45, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.079303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a774b-2006-4a02-8dcf-84c93c9f9d4a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.098149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0d79f1c3-6ddd-4c5b-a0c5-903582aa287b None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:45.099696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0d79f1c3-6ddd-4c5b-a0c5-903582aa287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:45.105050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 807/1630] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:45 2022] PUT /identity/v3/projects/577c2658460f4404b7281581975e7543/users/b77b231860ff4d8289dd71a746c27a45/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:45.106094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a774b-2006-4a02-8dcf-84c93c9f9d4a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.185848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:45.203560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 824/1631] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:45.208332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f1c3-6ddd-4c5b-a0c5-903582aa287b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.212273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a774b-2006-4a02-8dcf-84c93c9f9d4a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.226772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79f1c3-6ddd-4c5b-a0c5-903582aa287b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.228279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33455-a79e-4f0c-8e1c-02e38f976a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.228997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33455-a79e-4f0c-8e1c-02e38f976a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.229289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33455-a79e-4f0c-8e1c-02e38f976a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.229567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33455-a79e-4f0c-8e1c-02e38f976a5c admin admin] PATH_INFO: `/v3/projects/ae7ea38c74814dee99b773c290849875/users/6b7ea64e501a496fba5e249bd079bc5b/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.245209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96005136-cdcc-4bff-b7b2-d0bd7b4a4048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.245907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96005136-cdcc-4bff-b7b2-d0bd7b4a4048 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.246186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96005136-cdcc-4bff-b7b2-d0bd7b4a4048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.246456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96005136-cdcc-4bff-b7b2-d0bd7b4a4048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.247119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96005136-cdcc-4bff-b7b2-d0bd7b4a4048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.248744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96005136-cdcc-4bff-b7b2-d0bd7b4a4048 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.261860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da33455-a79e-4f0c-8e1c-02e38f976a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7ea38c74814dee99b773c290849875, user_id=6b7ea64e501a496fba5e249bd079bc5b, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.262924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 825/1632] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:45.263804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96005136-cdcc-4bff-b7b2-d0bd7b4a4048 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.274888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96005136-cdcc-4bff-b7b2-d0bd7b4a4048 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.286340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db10e-7568-4688-aa96-f18b4c162006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.286958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db10e-7568-4688-aa96-f18b4c162006 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.287240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db10e-7568-4688-aa96-f18b4c162006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.287515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171db10e-7568-4688-aa96-f18b4c162006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.287900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da33455-a79e-4f0c-8e1c-02e38f976a5c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.288221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171db10e-7568-4688-aa96-f18b4c162006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.290065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171db10e-7568-4688-aa96-f18b4c162006 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.305455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 826/1633] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:45.305455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db10e-7568-4688-aa96-f18b4c162006 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.319404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 808/1634] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:45 2022] PUT /identity/v3/projects/ae7ea38c74814dee99b773c290849875/users/6b7ea64e501a496fba5e249bd079bc5b/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:45.321328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33455-a79e-4f0c-8e1c-02e38f976a5c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.342984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:45.378649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171db10e-7568-4688-aa96-f18b4c162006 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.466250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2f8c3-46e3-4efb-a65d-199cdf17de52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.467269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f8c3-46e3-4efb-a65d-199cdf17de52 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.467413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f8c3-46e3-4efb-a65d-199cdf17de52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.467889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2f8c3-46e3-4efb-a65d-199cdf17de52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.555078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33455-a79e-4f0c-8e1c-02e38f976a5c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.563709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf402ea2-5d03-4bd4-97aa-01cc464df7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.564779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf402ea2-5d03-4bd4-97aa-01cc464df7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.565332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf402ea2-5d03-4bd4-97aa-01cc464df7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.565889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf402ea2-5d03-4bd4-97aa-01cc464df7b6 admin admin] PATH_INFO: `/v3/projects/7c4b24c0998244188eff07beb44ae84c/users/eba34ce828244ffdbb1e9c95b39ed9da/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.573933 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf402ea2-5d03-4bd4-97aa-01cc464df7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4b24c0998244188eff07beb44ae84c, user_id=eba34ce828244ffdbb1e9c95b39ed9da, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.585632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf402ea2-5d03-4bd4-97aa-01cc464df7b6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.620632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2f8c3-46e3-4efb-a65d-199cdf17de52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.630705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 809/1635] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:45 2022] PUT /identity/v3/projects/7c4b24c0998244188eff07beb44ae84c/users/eba34ce828244ffdbb1e9c95b39ed9da/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:45.630705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf402ea2-5d03-4bd4-97aa-01cc464df7b6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.644322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2f8c3-46e3-4efb-a65d-199cdf17de52 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.671495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 827/1636] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:45.672378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2f8c3-46e3-4efb-a65d-199cdf17de52 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.698016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2f8c3-46e3-4efb-a65d-199cdf17de52 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.810986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d1cf6-f914-4dda-a773-08b40b243ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.811629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d1cf6-f914-4dda-a773-08b40b243ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.811917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d1cf6-f914-4dda-a773-08b40b243ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.812187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d1cf6-f914-4dda-a773-08b40b243ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.812849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d1cf6-f914-4dda-a773-08b40b243ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.814507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d1cf6-f914-4dda-a773-08b40b243ea7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.821715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf402ea2-5d03-4bd4-97aa-01cc464df7b6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:45.841214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 828/1637] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:45.841503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36312e-29c2-4f63-b250-657be0699f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:45.841503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36312e-29c2-4f63-b250-657be0699f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.841503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36312e-29c2-4f63-b250-657be0699f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.841783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1828e0-6061-4f64-82f5-168aa4688b9c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:45.842510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1828e0-6061-4f64-82f5-168aa4688b9c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:45.842627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36312e-29c2-4f63-b250-657be0699f7f admin admin] PATH_INFO: `/v3/projects/577c2658460f4404b7281581975e7543/users/b77b231860ff4d8289dd71a746c27a45/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.842736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1828e0-6061-4f64-82f5-168aa4688b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:45.847887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36312e-29c2-4f63-b250-657be0699f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=577c2658460f4404b7281581975e7543, user_id=b77b231860ff4d8289dd71a746c27a45, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:45.858418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36312e-29c2-4f63-b250-657be0699f7f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:45.901511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 810/1638] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:45 2022] PUT /identity/v3/projects/577c2658460f4404b7281581975e7543/users/b77b231860ff4d8289dd71a746c27a45/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:45.903450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36312e-29c2-4f63-b250-657be0699f7f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:45.920259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8d1828e0-6061-4f64-82f5-168aa4688b9c None None] MFA Rules not processed for user `eba34ce828244ffdbb1e9c95b39ed9da`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:45.921799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8d1828e0-6061-4f64-82f5-168aa4688b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:45.952980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:46.051825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36312e-29c2-4f63-b250-657be0699f7f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:46.060064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61a2f8-d529-4425-aaf4-1ec9bf998626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:46.060766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a2f8-d529-4425-aaf4-1ec9bf998626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:46.061227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a2f8-d529-4425-aaf4-1ec9bf998626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:46.061510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61a2f8-d529-4425-aaf4-1ec9bf998626 admin admin] PATH_INFO: `/v3/projects/ae7ea38c74814dee99b773c290849875/users/6b7ea64e501a496fba5e249bd079bc5b/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:46.069957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61a2f8-d529-4425-aaf4-1ec9bf998626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7ea38c74814dee99b773c290849875, user_id=6b7ea64e501a496fba5e249bd079bc5b, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:46.072998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61a2f8-d529-4425-aaf4-1ec9bf998626 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:46.086763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:46.096724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 829/1639] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:46.098326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0086e8-74bb-4bc7-96e8-000f92cdd1db None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:46.098614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0086e8-74bb-4bc7-96e8-000f92cdd1db None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:46.098886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0086e8-74bb-4bc7-96e8-000f92cdd1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:46.104294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 811/1640] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:45 2022] PUT /identity/v3/projects/ae7ea38c74814dee99b773c290849875/users/6b7ea64e501a496fba5e249bd079bc5b/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:46.113567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61a2f8-d529-4425-aaf4-1ec9bf998626 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:46.211640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4f0086e8-74bb-4bc7-96e8-000f92cdd1db None None] MFA Rules not processed for user `b77b231860ff4d8289dd71a746c27a45`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:46.215734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4f0086e8-74bb-4bc7-96e8-000f92cdd1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:46.232976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61a2f8-d529-4425-aaf4-1ec9bf998626 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:46.237337 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af95993-0532-428b-834e-afaf2abd268c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:46.238054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af95993-0532-428b-834e-afaf2abd268c service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:46.238333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af95993-0532-428b-834e-afaf2abd268c service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:46.238638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af95993-0532-428b-834e-afaf2abd268c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:46.376646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af95993-0532-428b-834e-afaf2abd268c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:46.378150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af95993-0532-428b-834e-afaf2abd268c service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:46.411209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 812/1641] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:46.412719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ce44-7167-4ff9-84cc-38693a56ae6f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:46.413001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ce44-7167-4ff9-84cc-38693a56ae6f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:46.413301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ce44-7167-4ff9-84cc-38693a56ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:46.494784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9349ce44-7167-4ff9-84cc-38693a56ae6f None None] MFA Rules not processed for user `6b7ea64e501a496fba5e249bd079bc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:46.496036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9349ce44-7167-4ff9-84cc-38693a56ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:46.580320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 830/1642] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:46.596514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0086e8-74bb-4bc7-96e8-000f92cdd1db None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:46.624788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0086e8-74bb-4bc7-96e8-000f92cdd1db None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:46.640101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105835-6899-49f8-862b-6b82168092e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:46.641470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105835-6899-49f8-862b-6b82168092e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:46.642990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105835-6899-49f8-862b-6b82168092e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:46.643394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105835-6899-49f8-862b-6b82168092e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:46.667138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 813/1643] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:46.678017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e105835-6899-49f8-862b-6b82168092e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:46.679522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e105835-6899-49f8-862b-6b82168092e8 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:46.694195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 831/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:46.863908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349ce44-7167-4ff9-84cc-38693a56ae6f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:46.878038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349ce44-7167-4ff9-84cc-38693a56ae6f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:46.921547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf844ec-107d-4bdf-92cf-0127120bb1ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:46.924061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf844ec-107d-4bdf-92cf-0127120bb1ca service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:46.925760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf844ec-107d-4bdf-92cf-0127120bb1ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:46.926932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf844ec-107d-4bdf-92cf-0127120bb1ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:46.963890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf844ec-107d-4bdf-92cf-0127120bb1ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:46.967656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf844ec-107d-4bdf-92cf-0127120bb1ca service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:47.010275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 814/1645] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:47.156536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105835-6899-49f8-862b-6b82168092e8 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:47.275286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf844ec-107d-4bdf-92cf-0127120bb1ca service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:47.285550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf844ec-107d-4bdf-92cf-0127120bb1ca service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:47.296593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0531121-8481-43a6-a583-0e5b02aa997c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:47.297363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0531121-8481-43a6-a583-0e5b02aa997c service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:47.298177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0531121-8481-43a6-a583-0e5b02aa997c service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:47.298458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0531121-8481-43a6-a583-0e5b02aa997c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:47.327183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:47.387967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105835-6899-49f8-862b-6b82168092e8 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:47.416265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:47.417299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:47.417599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:47.418565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] PATH_INFO: `/v3/users/3a0302dc62c04e839db94cb2a630b5f4` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:47.423157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0302dc62c04e839db94cb2a630b5f4)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:47.424266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: WARNING py.warnings [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:18:47.424266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: warnings.warn(msg) Aug 31 05:18:47.424266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: Aug 31 05:18:47.438877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:47.462711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0531121-8481-43a6-a583-0e5b02aa997c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:47.466742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0531121-8481-43a6-a583-0e5b02aa997c service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:47.502403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 815/1646] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:47.503416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0531121-8481-43a6-a583-0e5b02aa997c service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:47.528722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:47.532993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0531121-8481-43a6-a583-0e5b02aa997c service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:47.548289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31154c-80da-4806-aa57-a64fdc907d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:47.549016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31154c-80da-4806-aa57-a64fdc907d3e service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:47.549258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31154c-80da-4806-aa57-a64fdc907d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:47.549474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31154c-80da-4806-aa57-a64fdc907d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:47.573830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0302dc62c04e839db94cb2a630b5f4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:47.574959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0302dc62c04e839db94cb2a630b5f4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:47.613412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0302dc62c04e839db94cb2a630b5f4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:47.639068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0302dc62c04e839db94cb2a630b5f4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:47.656026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-54c15799-99c5-42bc-b72b-90f91b02120b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0302dc62c04e839db94cb2a630b5f4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:47.669608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 832/1647] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:18:47 2022] DELETE /identity/v3/users/3a0302dc62c04e839db94cb2a630b5f4 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:47.671571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dbc47-38cd-411d-a21c-42b9fbf7af45 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:47.671850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dbc47-38cd-411d-a21c-42b9fbf7af45 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:47.672247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dbc47-38cd-411d-a21c-42b9fbf7af45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:47.713489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-471dbc47-38cd-411d-a21c-42b9fbf7af45 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:47.714801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-471dbc47-38cd-411d-a21c-42b9fbf7af45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:47.751003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31154c-80da-4806-aa57-a64fdc907d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:47.752802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31154c-80da-4806-aa57-a64fdc907d3e service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:47.791736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 816/1648] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:47.884169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 833/1649] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:47.922929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31154c-80da-4806-aa57-a64fdc907d3e service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:47.931113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b38c-ac2f-4c61-947e-1ed404c122c1 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:47.931723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b38c-ac2f-4c61-947e-1ed404c122c1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:47.932213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017b38c-ac2f-4c61-947e-1ed404c122c1 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:47.933841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 834/1650] 10.222.0.17 () {54 vars in 962 bytes} [Wed Aug 31 05:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:18:47.958684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35795dc-cfee-46e9-86a8-5b19e48c4642 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:47.959253 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35795dc-cfee-46e9-86a8-5b19e48c4642 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:47.959733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35795dc-cfee-46e9-86a8-5b19e48c4642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:47.997688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b35795dc-cfee-46e9-86a8-5b19e48c4642 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:47.998953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b35795dc-cfee-46e9-86a8-5b19e48c4642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:48.128817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31154c-80da-4806-aa57-a64fdc907d3e service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:48.238132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 835/1651] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Aug 31 05:18:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:48.247459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e93e4-8960-4a03-a26f-45aa93a853e2 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:48.247806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e93e4-8960-4a03-a26f-45aa93a853e2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:48.248028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e93e4-8960-4a03-a26f-45aa93a853e2 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:48.250414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 836/1652] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 31 05:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:18:48.262404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb51b-f388-4503-8ea6-18f1b081d8d8 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:48.262404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb51b-f388-4503-8ea6-18f1b081d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:48.262404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265eb51b-f388-4503-8ea6-18f1b081d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:48.285339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:48.287192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:48.307853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:48.308114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:48.343530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-265eb51b-f388-4503-8ea6-18f1b081d8d8 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:48.344247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:48.346174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:48.351636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-265eb51b-f388-4503-8ea6-18f1b081d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:48.391840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 817/1653] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:48.395045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 837/1654] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:18:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:18:48.464845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:48.464845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:48.487812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:48.563392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9858d2-10af-45f1-89d8-788f4144fdbd service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:48.570575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbdccc-5d18-4550-b129-5e5a425f5967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:48.572307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbdccc-5d18-4550-b129-5e5a425f5967 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:48.573519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbdccc-5d18-4550-b129-5e5a425f5967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:48.573989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbdccc-5d18-4550-b129-5e5a425f5967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:48.591250 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbdccc-5d18-4550-b129-5e5a425f5967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:48.593290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbdccc-5d18-4550-b129-5e5a425f5967 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:48.609457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 818/1655] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:51.833554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265eb51b-f388-4503-8ea6-18f1b081d8d8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:51.837050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-265eb51b-f388-4503-8ea6-18f1b081d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:51.898927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265eb51b-f388-4503-8ea6-18f1b081d8d8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:51.908540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:51.909724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:51.927856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:51.928382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] PATH_INFO: `/v3/projects/c167aad0619d48afa3b3dc13da18213c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:51.931312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c167aad0619d48afa3b3dc13da18213c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:51.933257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:52.035787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:52.117681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c167aad0619d48afa3b3dc13da18213c', 'request_id': 'req-a570734a-f6c6-4786-bf7b-248fd5e902d5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.135926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c167aad0619d48afa3b3dc13da18213c', 'request_id': 'req-a570734a-f6c6-4786-bf7b-248fd5e902d5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.146844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c167aad0619d48afa3b3dc13da18213c', 'request_id': 'req-a570734a-f6c6-4786-bf7b-248fd5e902d5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.175676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] The token cache is being invalidate because project c167aad0619d48afa3b3dc13da18213c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:18:52.176081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.176767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.180748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 838/1656] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:18:51 2022] DELETE /identity/v3/projects/c167aad0619d48afa3b3dc13da18213c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:52.184501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbdccc-5d18-4550-b129-5e5a425f5967 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:52.214434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbdccc-5d18-4550-b129-5e5a425f5967 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:52.424180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:52.425125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:52.425483 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:52.425816 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] PATH_INFO: `/v3/users/eba34ce828244ffdbb1e9c95b39ed9da` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:52.428060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba34ce828244ffdbb1e9c95b39ed9da)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:52.430367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:52.567037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba34ce828244ffdbb1e9c95b39ed9da'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.588472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba34ce828244ffdbb1e9c95b39ed9da'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.604429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba34ce828244ffdbb1e9c95b39ed9da'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.633203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba34ce828244ffdbb1e9c95b39ed9da'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.634162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-e30816a1-9345-4d81-a2b5-255efafddf0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba34ce828244ffdbb1e9c95b39ed9da'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:52.652615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 819/1657] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:18:52 2022] DELETE /identity/v3/users/eba34ce828244ffdbb1e9c95b39ed9da => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:53.707918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:53.712958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:53.785631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570734a-f6c6-4786-bf7b-248fd5e902d5 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:54.015536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:54.016653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:54.017700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:54.018463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] PATH_INFO: `/v3/users/7539b3d3269b45e8a57afb7f5afc6f2d` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:54.023555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7539b3d3269b45e8a57afb7f5afc6f2d)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:54.048969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:54.170882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7539b3d3269b45e8a57afb7f5afc6f2d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:54.171829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7539b3d3269b45e8a57afb7f5afc6f2d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:54.204235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7539b3d3269b45e8a57afb7f5afc6f2d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:54.214948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7539b3d3269b45e8a57afb7f5afc6f2d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:54.228758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0de4d00e-b69c-4c84-9393-ca95230580cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7539b3d3269b45e8a57afb7f5afc6f2d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:54.246278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 839/1658] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:18:53 2022] DELETE /identity/v3/users/7539b3d3269b45e8a57afb7f5afc6f2d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:54.251177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d3a1d-b64e-4808-a100-e73d07a74d28 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:54.251772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d3a1d-b64e-4808-a100-e73d07a74d28 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:54.251772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d3a1d-b64e-4808-a100-e73d07a74d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:54.290794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ef1d3a1d-b64e-4808-a100-e73d07a74d28 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:54.292524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ef1d3a1d-b64e-4808-a100-e73d07a74d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:54.404612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530cb91-c50b-4f1f-9998-ecf8543656ad None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:54.406707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530cb91-c50b-4f1f-9998-ecf8543656ad None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:54.407222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530cb91-c50b-4f1f-9998-ecf8543656ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:54.416082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:54.454872 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b530cb91-c50b-4f1f-9998-ecf8543656ad None None] MFA Rules not processed for user `b18cbec44ebd4bd38a352b5ebeb61a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:54.458105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b530cb91-c50b-4f1f-9998-ecf8543656ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:54.483399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 820/1659] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:54.498414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:54.586166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 840/1660] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:54.594569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98be1a-2153-43b4-acce-ebbba48842cb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:54.594947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98be1a-2153-43b4-acce-ebbba48842cb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:54.595341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98be1a-2153-43b4-acce-ebbba48842cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:54.618892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1c98be1a-2153-43b4-acce-ebbba48842cb None None] MFA Rules not processed for user `b18cbec44ebd4bd38a352b5ebeb61a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:54.620511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1c98be1a-2153-43b4-acce-ebbba48842cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:54.633779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 821/1661] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:54.639459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530cb91-c50b-4f1f-9998-ecf8543656ad None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:54.641037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b530cb91-c50b-4f1f-9998-ecf8543656ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:54.671618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98be1a-2153-43b4-acce-ebbba48842cb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:54.673603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1c98be1a-2153-43b4-acce-ebbba48842cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:54.800269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98be1a-2153-43b4-acce-ebbba48842cb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:54.806971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:54.807514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:54.807891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:54.808272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:54.824382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:54.826863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:54.840722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530cb91-c50b-4f1f-9998-ecf8543656ad None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:54.857936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 822/1662] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:18:54.858110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0066c84-a981-4ff6-8765-9e1c742cab6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:54.858686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066c84-a981-4ff6-8765-9e1c742cab6f service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:54.858912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066c84-a981-4ff6-8765-9e1c742cab6f service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:54.859357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0066c84-a981-4ff6-8765-9e1c742cab6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:54.859472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:54.862406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:54.873632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0066c84-a981-4ff6-8765-9e1c742cab6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:54.877559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0066c84-a981-4ff6-8765-9e1c742cab6f service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:54.882296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163362e8-4d69-4862-b422-f2e4a88e6c1f service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:54.888021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:54.888997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:54.889592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:54.890130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] PATH_INFO: `/v3/projects/7c4b24c0998244188eff07beb44ae84c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:54.892535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4b24c0998244188eff07beb44ae84c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:54.894148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: WARNING py.warnings [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 05:18:54.894148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: warnings.warn(msg) Aug 31 05:18:54.894148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: Aug 31 05:18:54.895960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:54.929474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 841/1663] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:55.016545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4b24c0998244188eff07beb44ae84c', 'request_id': 'req-d72e544a-bbee-45f8-923d-522b3ddf9239'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:55.037473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4b24c0998244188eff07beb44ae84c', 'request_id': 'req-d72e544a-bbee-45f8-923d-522b3ddf9239'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:55.064336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4b24c0998244188eff07beb44ae84c', 'request_id': 'req-d72e544a-bbee-45f8-923d-522b3ddf9239'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:55.125204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] The token cache is being invalidate because project 7c4b24c0998244188eff07beb44ae84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:18:55.125204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:55.128721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d72e544a-bbee-45f8-923d-522b3ddf9239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:55.134915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 823/1664] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:18:54 2022] DELETE /identity/v3/projects/7c4b24c0998244188eff07beb44ae84c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:55.141469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8a24e-9f0e-48d8-9a7d-0f91da63b64b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:55.141990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8a24e-9f0e-48d8-9a7d-0f91da63b64b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:55.142479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8a24e-9f0e-48d8-9a7d-0f91da63b64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:55.190268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-bae8a24e-9f0e-48d8-9a7d-0f91da63b64b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:55.191856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-bae8a24e-9f0e-48d8-9a7d-0f91da63b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:55.271378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 842/1665] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:55.280883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c0b2-da28-4f75-8144-235504885b10 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:55.281471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c0b2-da28-4f75-8144-235504885b10 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:55.281547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488c0b2-da28-4f75-8144-235504885b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:55.322728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d488c0b2-da28-4f75-8144-235504885b10 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:55.324190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d488c0b2-da28-4f75-8144-235504885b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:55.343283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 824/1666] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:55.346888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8a24e-9f0e-48d8-9a7d-0f91da63b64b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:55.365481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8a24e-9f0e-48d8-9a7d-0f91da63b64b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:55.379265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:55.379906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:55.380188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:55.380461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:55.381153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:55.381464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:55.383123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:55.411721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 843/1667] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:55.414678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488c0b2-da28-4f75-8144-235504885b10 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:55.428604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488c0b2-da28-4f75-8144-235504885b10 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:55.438953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2345c7-4036-4693-8020-acad8116e009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:55.440323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2345c7-4036-4693-8020-acad8116e009 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:55.442448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2345c7-4036-4693-8020-acad8116e009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:55.442958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2345c7-4036-4693-8020-acad8116e009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:55.445313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2345c7-4036-4693-8020-acad8116e009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:55.451072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2345c7-4036-4693-8020-acad8116e009 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:55.519257 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 825/1668] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:55 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:55.527243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:55.568167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442d4aa-f551-4886-b985-a25122a58138 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:55.645634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:55.713273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c2ec5-c99c-4fc7-bdfb-48631e63fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:55.715302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c2ec5-c99c-4fc7-bdfb-48631e63fae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:55.715759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c2ec5-c99c-4fc7-bdfb-48631e63fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:55.717554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c2ec5-c99c-4fc7-bdfb-48631e63fae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:55.718447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c2ec5-c99c-4fc7-bdfb-48631e63fae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:55.724260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c2ec5-c99c-4fc7-bdfb-48631e63fae6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:55.770471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 844/1669] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:55 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:55.773730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2345c7-4036-4693-8020-acad8116e009 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:55.787363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2345c7-4036-4693-8020-acad8116e009 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:55.799916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5076ef-9d07-4f58-a6a8-ad8b05047cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:55.805226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5076ef-9d07-4f58-a6a8-ad8b05047cef admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:55.806468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5076ef-9d07-4f58-a6a8-ad8b05047cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:55.806941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5076ef-9d07-4f58-a6a8-ad8b05047cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:55.812322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5076ef-9d07-4f58-a6a8-ad8b05047cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:55.816499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5076ef-9d07-4f58-a6a8-ad8b05047cef admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:55.856991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 826/1670] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:55.861192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c2ec5-c99c-4fc7-bdfb-48631e63fae6 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:55.881945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c2ec5-c99c-4fc7-bdfb-48631e63fae6 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:55.897601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ac2b-4583-44fe-a402-83e3de63f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:55.898551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ac2b-4583-44fe-a402-83e3de63f965 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:55.898893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ac2b-4583-44fe-a402-83e3de63f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:55.899200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ac2b-4583-44fe-a402-83e3de63f965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:55.900237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ac2b-4583-44fe-a402-83e3de63f965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:55.906962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ac2b-4583-44fe-a402-83e3de63f965 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:55.933046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 845/1671] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:55.937539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5076ef-9d07-4f58-a6a8-ad8b05047cef admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:55.964438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5076ef-9d07-4f58-a6a8-ad8b05047cef admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:55.976174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee50fc7-892c-4345-8c8c-40f781f60c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:55.977132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50fc7-892c-4345-8c8c-40f781f60c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:55.977539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50fc7-892c-4345-8c8c-40f781f60c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:55.977771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50fc7-892c-4345-8c8c-40f781f60c58 admin admin] PATH_INFO: `/v3/projects/c3ca9033c6b641f29fcbc0f5f0d8891c/users/aa710e47991e4fbd941a6b2cb5e869c7/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:56.028186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee50fc7-892c-4345-8c8c-40f781f60c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ca9033c6b641f29fcbc0f5f0d8891c, user_id=aa710e47991e4fbd941a6b2cb5e869c7, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:56.033549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee50fc7-892c-4345-8c8c-40f781f60c58 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:56.037557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:56.079677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 827/1672] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:55 2022] PUT /identity/v3/projects/c3ca9033c6b641f29fcbc0f5f0d8891c/users/aa710e47991e4fbd941a6b2cb5e869c7/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:56.081181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8046-4c8c-4da1-a613-eb824fabd51a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:56.081539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8046-4c8c-4da1-a613-eb824fabd51a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:56.082773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8046-4c8c-4da1-a613-eb824fabd51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:56.181641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-dd5b8046-4c8c-4da1-a613-eb824fabd51a None None] MFA Rules not processed for user `aa710e47991e4fbd941a6b2cb5e869c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:56.190527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-dd5b8046-4c8c-4da1-a613-eb824fabd51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:56.351777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 846/1673] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:56.356417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee50fc7-892c-4345-8c8c-40f781f60c58 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:56.437182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b8046-4c8c-4da1-a613-eb824fabd51a None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:56.438998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-dd5b8046-4c8c-4da1-a613-eb824fabd51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:56.494062 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee50fc7-892c-4345-8c8c-40f781f60c58 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:56.504390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f7e05-ec55-4b78-bcd3-eff46d042310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:56.507040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7e05-ec55-4b78-bcd3-eff46d042310 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:56.507673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7e05-ec55-4b78-bcd3-eff46d042310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:56.508268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f7e05-ec55-4b78-bcd3-eff46d042310 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:56.510752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f7e05-ec55-4b78-bcd3-eff46d042310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:56.515103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f7e05-ec55-4b78-bcd3-eff46d042310 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:56.562600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 828/1674] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:56 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:56.566785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041000e-df7f-41bf-8d4a-654f32cfe1d5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:56.568395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041000e-df7f-41bf-8d4a-654f32cfe1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:56.568841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041000e-df7f-41bf-8d4a-654f32cfe1d5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:56.571678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 829/1675] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 31 05:18:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:18:56.575193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041000e-df7f-41bf-8d4a-654f32cfe1d5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:56.594946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b8046-4c8c-4da1-a613-eb824fabd51a None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:56.728857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041000e-df7f-41bf-8d4a-654f32cfe1d5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:56.735353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc70d2-a328-4506-b04d-312e29537a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:56.736122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc70d2-a328-4506-b04d-312e29537a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:56.736617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc70d2-a328-4506-b04d-312e29537a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:56.737587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc70d2-a328-4506-b04d-312e29537a99 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:56.738396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc70d2-a328-4506-b04d-312e29537a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:56.740963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc70d2-a328-4506-b04d-312e29537a99 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:56.754980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:56.787450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 830/1676] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:56 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:56.790882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:56.791541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:56.791670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3e4d-c294-4db1-8cb9-c29aa52c41fa None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:56.791821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:56.792094 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] PATH_INFO: `/v3/users/e9090f91f5794af6ade9585073fe0005` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:56.793108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3e4d-c294-4db1-8cb9-c29aa52c41fa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:56.793907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9090f91f5794af6ade9585073fe0005)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:56.794295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3e4d-c294-4db1-8cb9-c29aa52c41fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:56.802240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:56.894068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9090f91f5794af6ade9585073fe0005'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:56.896379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9090f91f5794af6ade9585073fe0005'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:56.922098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-821b3e4d-c294-4db1-8cb9-c29aa52c41fa None None] MFA Rules not processed for user `45dadcdc0903427ca598dcd0bf06a6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:56.924114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-821b3e4d-c294-4db1-8cb9-c29aa52c41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:56.946093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9090f91f5794af6ade9585073fe0005'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:56.963942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9090f91f5794af6ade9585073fe0005'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:56.986117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9090f91f5794af6ade9585073fe0005'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:56.997040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 847/1677] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:18:56 2022] DELETE /identity/v3/users/e9090f91f5794af6ade9585073fe0005 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:57.000084 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:57.002468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.104450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 831/1678] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:18:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:57.115775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b3e4d-c294-4db1-8cb9-c29aa52c41fa None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:57.124704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-821b3e4d-c294-4db1-8cb9-c29aa52c41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.151370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:57.160823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b3e4d-c294-4db1-8cb9-c29aa52c41fa None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:57.167856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10be2e-d8c0-4494-b7c9-aa7ef63126dc admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:57.179839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4222c-6620-4306-84d2-c5a8c21af050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:57.182335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4222c-6620-4306-84d2-c5a8c21af050 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.182648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4222c-6620-4306-84d2-c5a8c21af050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.182925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4222c-6620-4306-84d2-c5a8c21af050 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:57.183611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4222c-6620-4306-84d2-c5a8c21af050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:57.186197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4222c-6620-4306-84d2-c5a8c21af050 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:57.186732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:57.187798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.189424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.189906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] PATH_INFO: `/v3/users/7b61afb3d3f94c699fc5a007433e4d08` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:57.199741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b61afb3d3f94c699fc5a007433e4d08)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:57.202170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:57.212135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 848/1679] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:57.213500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c24002-9aca-44df-8271-d90e848f4717 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.213862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c24002-9aca-44df-8271-d90e848f4717 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.214987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c24002-9aca-44df-8271-d90e848f4717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:57.265073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-78c24002-9aca-44df-8271-d90e848f4717 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:57.269984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-78c24002-9aca-44df-8271-d90e848f4717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.305699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 849/1680] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:57.308116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c24002-9aca-44df-8271-d90e848f4717 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:57.331364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b61afb3d3f94c699fc5a007433e4d08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.336443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c24002-9aca-44df-8271-d90e848f4717 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:57.351559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:57.352196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.352479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.352846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:57.353714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:57.356975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:57.365059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b61afb3d3f94c699fc5a007433e4d08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.388980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b61afb3d3f94c699fc5a007433e4d08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.394074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 850/1681] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:57.402370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:57.421642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.433650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b61afb3d3f94c699fc5a007433e4d08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.435234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b61afb3d3f94c699fc5a007433e4d08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.446163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 832/1682] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:18:57 2022] DELETE /identity/v3/users/7b61afb3d3f94c699fc5a007433e4d08 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:57.451466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:57.455289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.593259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:57.606001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad43052-642e-4053-9cbf-50f62015d321 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:57.656235 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b7fb-7c55-4b05-b5fe-1244ac11e050 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:57.669853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:57.670642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.671162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.671575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] PATH_INFO: `/v3/projects/93b12b25252542f4bbd58d6b048fade8` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:57.673634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b12b25252542f4bbd58d6b048fade8)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:57.676912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:57.711912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:57.712544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.712831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.713190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:57.716462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.735341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:57.737026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:57.750993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 851/1683] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:57.759270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:57.763390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.776946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da69a78-3d90-41ec-8a12-03a0605abd49 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:57.788022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b12b25252542f4bbd58d6b048fade8', 'request_id': 'req-6d33b269-0b0a-4945-a9b9-e37c37698077'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.798888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b12b25252542f4bbd58d6b048fade8', 'request_id': 'req-6d33b269-0b0a-4945-a9b9-e37c37698077'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.807587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b12b25252542f4bbd58d6b048fade8', 'request_id': 'req-6d33b269-0b0a-4945-a9b9-e37c37698077'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.822193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] The token cache is being invalidate because project 93b12b25252542f4bbd58d6b048fade8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:18:57.822755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.823582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:18:57.829347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 833/1684] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:18:57 2022] DELETE /identity/v3/projects/93b12b25252542f4bbd58d6b048fade8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:57.830733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:57.832388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.844374 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:57.927631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33b269-0b0a-4945-a9b9-e37c37698077 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:57.940007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2366c-4cf8-41c0-98d2-f986a7fe41c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:57.941031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2366c-4cf8-41c0-98d2-f986a7fe41c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.941552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2366c-4cf8-41c0-98d2-f986a7fe41c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.941970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2366c-4cf8-41c0-98d2-f986a7fe41c3 admin admin] PATH_INFO: `/v3/projects/662f94a103bf4484b3fbf3ca0c79a6a5/users/0f3fd48302c249f785b74aa63a1e70aa/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:57.945987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cab37-c2cb-4e20-b038-82925ecace13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:57.946701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cab37-c2cb-4e20-b038-82925ecace13 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.947059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cab37-c2cb-4e20-b038-82925ecace13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.947396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cab37-c2cb-4e20-b038-82925ecace13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:57.949464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-da8cab37-c2cb-4e20-b038-82925ecace13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:57.968657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cab37-c2cb-4e20-b038-82925ecace13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:57.970222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cab37-c2cb-4e20-b038-82925ecace13 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:57.985641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2366c-4cf8-41c0-98d2-f986a7fe41c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662f94a103bf4484b3fbf3ca0c79a6a5, user_id=0f3fd48302c249f785b74aa63a1e70aa, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:57.987780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 852/1685] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:57.990252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4e6e-ebd7-497a-8c8b-3cecdd68bbde None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:57.991189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2366c-4cf8-41c0-98d2-f986a7fe41c3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:57.991805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4e6e-ebd7-497a-8c8b-3cecdd68bbde None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:57.994576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4e6e-ebd7-497a-8c8b-3cecdd68bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:58.017377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 834/1686] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:57 2022] PUT /identity/v3/projects/662f94a103bf4484b3fbf3ca0c79a6a5/users/0f3fd48302c249f785b74aa63a1e70aa/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:58.018946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b43e9-c4ad-4167-8a3d-8b06c5330da0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:58.019370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b43e9-c4ad-4167-8a3d-8b06c5330da0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:58.019826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b43e9-c4ad-4167-8a3d-8b06c5330da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:58.040204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-338a4e6e-ebd7-497a-8c8b-3cecdd68bbde None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:58.046280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-338a4e6e-ebd7-497a-8c8b-3cecdd68bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:58.082730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-088b43e9-c4ad-4167-8a3d-8b06c5330da0 None None] MFA Rules not processed for user `9032773d56f84e7c889b189b21803c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:58.084053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-088b43e9-c4ad-4167-8a3d-8b06c5330da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:58.272030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 853/1687] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:58.275107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28239-1dab-4f66-a288-31843a588a67 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:58.275434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28239-1dab-4f66-a288-31843a588a67 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:58.275714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d28239-1dab-4f66-a288-31843a588a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:58.295097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 835/1688] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:58.295097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36ff89-3a6e-425f-aa7e-052c32ab004e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:58.295097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36ff89-3a6e-425f-aa7e-052c32ab004e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:58.295097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36ff89-3a6e-425f-aa7e-052c32ab004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:58.320780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-89d28239-1dab-4f66-a288-31843a588a67 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:58.322128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-89d28239-1dab-4f66-a288-31843a588a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:58.337191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 854/1689] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:58.338121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d28239-1dab-4f66-a288-31843a588a67 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:58.345734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-89d28239-1dab-4f66-a288-31843a588a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:58.396554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ed36ff89-3a6e-425f-aa7e-052c32ab004e None None] MFA Rules not processed for user `0f3fd48302c249f785b74aa63a1e70aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:58.404923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ed36ff89-3a6e-425f-aa7e-052c32ab004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:58.496121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:58.551141 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d28239-1dab-4f66-a288-31843a588a67 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:58.558836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612961a1-5e2b-4e86-9d87-00530fb254b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:58.559537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612961a1-5e2b-4e86-9d87-00530fb254b7 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:58.560920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612961a1-5e2b-4e86-9d87-00530fb254b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:58.560920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612961a1-5e2b-4e86-9d87-00530fb254b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:58.586875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 836/1690] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:58.588087 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36ff89-3a6e-425f-aa7e-052c32ab004e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:58.593844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ed36ff89-3a6e-425f-aa7e-052c32ab004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:58.602602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612961a1-5e2b-4e86-9d87-00530fb254b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:58.604220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612961a1-5e2b-4e86-9d87-00530fb254b7 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:58.614839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 855/1691] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:58.616210 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d324d8-69c2-44bb-b2e1-735a950fa49a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:58.616580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d324d8-69c2-44bb-b2e1-735a950fa49a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:58.617240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d324d8-69c2-44bb-b2e1-735a950fa49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:58.626656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:58.648694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-52d324d8-69c2-44bb-b2e1-735a950fa49a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:58.650664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-52d324d8-69c2-44bb-b2e1-735a950fa49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:58.661502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 856/1692] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:58.662421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d324d8-69c2-44bb-b2e1-735a950fa49a None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:58.678039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d324d8-69c2-44bb-b2e1-735a950fa49a None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:58.694856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a01116-b6da-454d-a965-538c7bebfa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:58.695445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01116-b6da-454d-a965-538c7bebfa29 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:58.695724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01116-b6da-454d-a965-538c7bebfa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:58.695993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a01116-b6da-454d-a965-538c7bebfa29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:58.696637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a01116-b6da-454d-a965-538c7bebfa29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:58.698859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a01116-b6da-454d-a965-538c7bebfa29 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:58.786327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 857/1693] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:58 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:58.789811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a01116-b6da-454d-a965-538c7bebfa29 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:58.807396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36ff89-3a6e-425f-aa7e-052c32ab004e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:58.947818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d707b2-edf7-4067-9a16-6971b52ef62c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:58.949919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d707b2-edf7-4067-9a16-6971b52ef62c service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:58.950224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d707b2-edf7-4067-9a16-6971b52ef62c service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:58.951038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d707b2-edf7-4067-9a16-6971b52ef62c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.010307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a01116-b6da-454d-a965-538c7bebfa29 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:59.030405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:59.031131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:59.031374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:59.032752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.033458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:18:59.033802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:59.035428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:59.067677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 858/1694] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:18:59.070921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:59.104818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c96e1-b2d7-4661-ba55-040ffaac8160 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:59.114314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a6d8-3e0f-4915-831a-5c242b4fe8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:59.115352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a6d8-3e0f-4915-831a-5c242b4fe8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:59.116932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a6d8-3e0f-4915-831a-5c242b4fe8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:59.117619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a6d8-3e0f-4915-831a-5c242b4fe8e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.118887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a6d8-3e0f-4915-831a-5c242b4fe8e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:59.123068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a6d8-3e0f-4915-831a-5c242b4fe8e3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:59.154353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 859/1695] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:59 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:59.155676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27f5b-6d07-4f37-83c1-b633e42e26a8 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:59.155965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27f5b-6d07-4f37-83c1-b633e42e26a8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:59.156237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27f5b-6d07-4f37-83c1-b633e42e26a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.174525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d707b2-edf7-4067-9a16-6971b52ef62c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:59.176378 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d707b2-edf7-4067-9a16-6971b52ef62c service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:59.219303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 837/1696] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:18:59.220015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d707b2-edf7-4067-9a16-6971b52ef62c service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:59.224730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-29d27f5b-6d07-4f37-83c1-b633e42e26a8 None None] MFA Rules not processed for user `359f2e7aebf74167bf87af802bccdbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:59.226630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-29d27f5b-6d07-4f37-83c1-b633e42e26a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:59.257490 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d707b2-edf7-4067-9a16-6971b52ef62c service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:59.286722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992881-9a08-4acb-abbe-a98ef4e57acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:59.289652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992881-9a08-4acb-abbe-a98ef4e57acb admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:59.290561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992881-9a08-4acb-abbe-a98ef4e57acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:59.291314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992881-9a08-4acb-abbe-a98ef4e57acb admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.293616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992881-9a08-4acb-abbe-a98ef4e57acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:59.302436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992881-9a08-4acb-abbe-a98ef4e57acb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:59.327328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 860/1697] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:59.328547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27f5b-6d07-4f37-83c1-b633e42e26a8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:59.337044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:59.350162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27f5b-6d07-4f37-83c1-b633e42e26a8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:59.362605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6279509-cd4e-467f-97d8-9ee7d9536764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:59.363252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279509-cd4e-467f-97d8-9ee7d9536764 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:59.363985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279509-cd4e-467f-97d8-9ee7d9536764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:59.365225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6279509-cd4e-467f-97d8-9ee7d9536764 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.366078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6279509-cd4e-467f-97d8-9ee7d9536764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:59.369871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6279509-cd4e-467f-97d8-9ee7d9536764 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:59.413174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 861/1698] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:18:59.417945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8252010-6101-4a02-a786-dde11b125bc6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:59.418238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8252010-6101-4a02-a786-dde11b125bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:59.419466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8252010-6101-4a02-a786-dde11b125bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.427797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 838/1699] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:18:59 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:59.428516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992881-9a08-4acb-abbe-a98ef4e57acb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:59.482700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d8252010-6101-4a02-a786-dde11b125bc6 None None] MFA Rules not processed for user `359f2e7aebf74167bf87af802bccdbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:18:59.484356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d8252010-6101-4a02-a786-dde11b125bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:18:59.654279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:18:59.690752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992881-9a08-4acb-abbe-a98ef4e57acb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:59.711869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 862/1700] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:18:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:18:59.718309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57102453-81c3-4f6a-8724-b95fa02487ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:59.719009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102453-81c3-4f6a-8724-b95fa02487ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:59.719285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102453-81c3-4f6a-8724-b95fa02487ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:59.719555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102453-81c3-4f6a-8724-b95fa02487ff admin admin] PATH_INFO: `/v3/projects/d73091917deb43f69bb2e45afcd63820/users/542f37bb0378494a86ee4cd544281f11/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.721296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8252010-6101-4a02-a786-dde11b125bc6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:59.760558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8252010-6101-4a02-a786-dde11b125bc6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:18:59.777434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57102453-81c3-4f6a-8724-b95fa02487ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73091917deb43f69bb2e45afcd63820, user_id=542f37bb0378494a86ee4cd544281f11, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:59.778490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dd094-b401-4774-bc8a-89ea13fec12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:18:59.779124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd094-b401-4774-bc8a-89ea13fec12e admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:18:59.779402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd094-b401-4774-bc8a-89ea13fec12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:18:59.779671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dd094-b401-4774-bc8a-89ea13fec12e admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:18:59.780309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dd094-b401-4774-bc8a-89ea13fec12e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:18:59.789338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57102453-81c3-4f6a-8724-b95fa02487ff admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:59.792417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dd094-b401-4774-bc8a-89ea13fec12e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:18:59.832253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 839/1701] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:18:59 2022] PUT /identity/v3/projects/d73091917deb43f69bb2e45afcd63820/users/542f37bb0378494a86ee4cd544281f11/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:18:59.833903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57102453-81c3-4f6a-8724-b95fa02487ff admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:59.870337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 863/1702] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:18:59 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:18:59.871462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dd094-b401-4774-bc8a-89ea13fec12e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:18:59.927515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dd094-b401-4774-bc8a-89ea13fec12e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:00.097028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57102453-81c3-4f6a-8724-b95fa02487ff admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:00.107336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102179f-e465-4762-a290-0d8a337dbcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:00.108057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102179f-e465-4762-a290-0d8a337dbcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:00.108225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102179f-e465-4762-a290-0d8a337dbcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:00.108495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102179f-e465-4762-a290-0d8a337dbcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:00.109167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102179f-e465-4762-a290-0d8a337dbcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:00.110763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102179f-e465-4762-a290-0d8a337dbcc8 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:00.114513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f0f0d-20bd-4184-8428-6c8d93d082b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:00.115180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f0f0d-20bd-4184-8428-6c8d93d082b9 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:00.115482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f0f0d-20bd-4184-8428-6c8d93d082b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:00.115730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f0f0d-20bd-4184-8428-6c8d93d082b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:00.140801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 864/1703] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:00.143832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102179f-e465-4762-a290-0d8a337dbcc8 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:00.165017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102179f-e465-4762-a290-0d8a337dbcc8 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:00.177666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:00.178406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:00.178681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:00.178984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:00.180667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:00.183375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:00.213739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 865/1704] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:00.214737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:00.223537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:00.237650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f0f0d-20bd-4184-8428-6c8d93d082b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:00.239840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f0f0d-20bd-4184-8428-6c8d93d082b9 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:00.252313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 840/1705] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:18:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:00.253406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f0f0d-20bd-4184-8428-6c8d93d082b9 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:00.264580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f0f0d-20bd-4184-8428-6c8d93d082b9 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:00.277465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:00.279222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:00.280804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:00.281197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] PATH_INFO: `/v3/projects/d73091917deb43f69bb2e45afcd63820/users/542f37bb0378494a86ee4cd544281f11/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:00.285801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73091917deb43f69bb2e45afcd63820, user_id=542f37bb0378494a86ee4cd544281f11, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:00.289882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:00.318234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 841/1706] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:00 2022] PUT /identity/v3/projects/d73091917deb43f69bb2e45afcd63820/users/542f37bb0378494a86ee4cd544281f11/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:00.331278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:00.337694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:00.448566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3db5e6-f911-4038-a4d4-bd1619a0cb9c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:00.468122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:00.546282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6db343-851f-40a6-9199-1ec3355279bb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:00.560804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:00.564837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:00.565205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:00.565491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] PATH_INFO: `/v3/projects/ad9a6ee52ad742e0a0273f24af7eb05b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:00.569953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9a6ee52ad742e0a0273f24af7eb05b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:00.572118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:00.577675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:00.613007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:00.625694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:00.626280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:00.626849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:00.640407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:00.670502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:00.676694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:00.694139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9a6ee52ad742e0a0273f24af7eb05b', 'request_id': 'req-120332a4-dd87-47c2-9522-00eeb92ce92b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:00.694430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 866/1707] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:00.696488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:00.714084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9a6ee52ad742e0a0273f24af7eb05b', 'request_id': 'req-120332a4-dd87-47c2-9522-00eeb92ce92b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:00.728335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414756e-99f7-4c7a-a171-3c8242ab6477 service placement] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:00.730249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9a6ee52ad742e0a0273f24af7eb05b', 'request_id': 'req-120332a4-dd87-47c2-9522-00eeb92ce92b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:00.773893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] The token cache is being invalidate because project ad9a6ee52ad742e0a0273f24af7eb05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:00.777535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:00.777535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-120332a4-dd87-47c2-9522-00eeb92ce92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:00.779093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 842/1708] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:00 2022] DELETE /identity/v3/projects/ad9a6ee52ad742e0a0273f24af7eb05b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:00.780719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6726d10-7c9d-48bd-8dea-e4495d9852d1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:00.781012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6726d10-7c9d-48bd-8dea-e4495d9852d1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:00.781361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6726d10-7c9d-48bd-8dea-e4495d9852d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:00.823049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d6726d10-7c9d-48bd-8dea-e4495d9852d1 None None] MFA Rules not processed for user `542f37bb0378494a86ee4cd544281f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:00.824461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d6726d10-7c9d-48bd-8dea-e4495d9852d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:00.930946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:00.932471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:00.934924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:00.935448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:00.937898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:00.945249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:00.975743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 867/1709] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:00.977124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:00.989261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:01.024428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24b3ea-1f00-4355-a630-5ae7e1a0c673 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:01.025900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 843/1710] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:01.026803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6726d10-7c9d-48bd-8dea-e4495d9852d1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:01.028195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d6726d10-7c9d-48bd-8dea-e4495d9852d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:01.048136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:01.049047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:01.049473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:01.050149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] PATH_INFO: `/v3/projects/a973fd9df19c4761bce300e16bf64ac6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:01.051627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a973fd9df19c4761bce300e16bf64ac6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:01.053765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:01.056844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6726d10-7c9d-48bd-8dea-e4495d9852d1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:01.071727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:01.072403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:01.072683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:01.072958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] PATH_INFO: `/v3/users/b77b231860ff4d8289dd71a746c27a45` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:01.076922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b77b231860ff4d8289dd71a746c27a45)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:01.079358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:01.194668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a973fd9df19c4761bce300e16bf64ac6', 'request_id': 'req-289dfe68-93b4-4702-b661-18751dcf222f'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.204384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a973fd9df19c4761bce300e16bf64ac6', 'request_id': 'req-289dfe68-93b4-4702-b661-18751dcf222f'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.224701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a973fd9df19c4761bce300e16bf64ac6', 'request_id': 'req-289dfe68-93b4-4702-b661-18751dcf222f'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.246697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b77b231860ff4d8289dd71a746c27a45'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.266588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] The token cache is being invalidate because project a973fd9df19c4761bce300e16bf64ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:01.267283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.268698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.271360 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 868/1711] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:00 2022] DELETE /identity/v3/projects/a973fd9df19c4761bce300e16bf64ac6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:01.272667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:01.275256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:01.292553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b77b231860ff4d8289dd71a746c27a45'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.303123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:01.310419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b77b231860ff4d8289dd71a746c27a45'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.327188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b77b231860ff4d8289dd71a746c27a45'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.330391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b77b231860ff4d8289dd71a746c27a45'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:01.354086 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 844/1712] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:01 2022] DELETE /identity/v3/users/b77b231860ff4d8289dd71a746c27a45 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:01.358014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:01.360402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:01.377868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:01.515046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dfe68-93b4-4702-b661-18751dcf222f admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:01.578070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2460d-314e-49db-9ec7-64c5ea7c3536 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:01.583883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:01.584523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:01.584805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:01.585125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:01.587301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:01.687267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b5984-fe47-4b0c-807d-99f7e0f0510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:01.690492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b5984-fe47-4b0c-807d-99f7e0f0510d admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:01.691203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b5984-fe47-4b0c-807d-99f7e0f0510d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:01.692455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b5984-fe47-4b0c-807d-99f7e0f0510d admin admin] PATH_INFO: `/v3/projects/223b6a1b882247b881bf907744682b62/users/fc80909b05c4483298d3cdd3972a7772/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:01.738619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b5984-fe47-4b0c-807d-99f7e0f0510d admin admin] RBAC: Authorizing `identity:create_grant(project_id=223b6a1b882247b881bf907744682b62, user_id=fc80909b05c4483298d3cdd3972a7772, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:01.741058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:01.741552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b5984-fe47-4b0c-807d-99f7e0f0510d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:01.742917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:01.763127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 845/1713] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:01.763731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:01.764770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 869/1714] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:01 2022] PUT /identity/v3/projects/223b6a1b882247b881bf907744682b62/users/fc80909b05c4483298d3cdd3972a7772/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:01.767157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd158-6b93-463d-b060-ca0d69625be6 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:01.767326 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:01.768767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd158-6b93-463d-b060-ca0d69625be6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:01.771968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd158-6b93-463d-b060-ca0d69625be6 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:01.774464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 870/1715] 10.222.0.17 () {54 vars in 912 bytes} [Wed Aug 31 05:19:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:19:01.779196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e65e-9adb-4f87-b915-8279848d905f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:01.780587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e65e-9adb-4f87-b915-8279848d905f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:01.780999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e65e-9adb-4f87-b915-8279848d905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:01.832104 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540d11e-58de-45da-8476-2d7ef49f8343 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:01.869855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a1f4e65e-9adb-4f87-b915-8279848d905f None None] MFA Rules not processed for user `fc80909b05c4483298d3cdd3972a7772`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:01.871698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a1f4e65e-9adb-4f87-b915-8279848d905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:02.033273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:02.035141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:02.035990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:02.035990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] PATH_INFO: `/v3/users/6b7ea64e501a496fba5e249bd079bc5b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:02.040714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7ea64e501a496fba5e249bd079bc5b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:02.044014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:02.142142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:02.168251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7ea64e501a496fba5e249bd079bc5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:02.181850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 871/1716] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:02.194697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf99da-f884-4491-829a-f9dacf832749 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:02.198030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf99da-f884-4491-829a-f9dacf832749 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:02.198572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf99da-f884-4491-829a-f9dacf832749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:02.220616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7ea64e501a496fba5e249bd079bc5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:02.250867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7ea64e501a496fba5e249bd079bc5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:02.279575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7ea64e501a496fba5e249bd079bc5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:02.280363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7ea64e501a496fba5e249bd079bc5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:02.282258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0baf99da-f884-4491-829a-f9dacf832749 None None] MFA Rules not processed for user `45dadcdc0903427ca598dcd0bf06a6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:02.296211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0baf99da-f884-4491-829a-f9dacf832749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:02.303392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 846/1717] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:01 2022] DELETE /identity/v3/users/6b7ea64e501a496fba5e249bd079bc5b => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:02.305772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:02.312587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:02.442588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:02.475559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 872/1718] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:19:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:02.569358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91ead-73e9-41d4-973e-049ba564e628 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:02.582062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf99da-f884-4491-829a-f9dacf832749 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:02.583397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6d3dc-ac07-4044-a2be-e0474cbae15e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:02.583860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0baf99da-f884-4491-829a-f9dacf832749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:02.584055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d3dc-ac07-4044-a2be-e0474cbae15e service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:02.586417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d3dc-ac07-4044-a2be-e0474cbae15e service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:02.586845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6d3dc-ac07-4044-a2be-e0474cbae15e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:02.590897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aef6d3dc-ac07-4044-a2be-e0474cbae15e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:02.602260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf99da-f884-4491-829a-f9dacf832749 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:02.608612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:02.611437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:02.611725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:02.612001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:02.644332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:02.645842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:02.681560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 873/1719] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:02.749969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d3dc-ac07-4044-a2be-e0474cbae15e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:02.751632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6d3dc-ac07-4044-a2be-e0474cbae15e service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:02.780530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 847/1720] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:03.373119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:03.381070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:03.548494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e259-6ee3-4291-a29f-3f608984505b service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:03.560203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:03.560885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:03.561195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:03.561758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:03.566385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:03.828209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:03.829708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:03.870079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 874/1721] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:03.916230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8e2a4-f8ea-4de6-b0b7-9e99f5d1cedd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:03.916753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8e2a4-f8ea-4de6-b0b7-9e99f5d1cedd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:03.916753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8e2a4-f8ea-4de6-b0b7-9e99f5d1cedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:04.002333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-88b8e2a4-f8ea-4de6-b0b7-9e99f5d1cedd None None] MFA Rules not processed for user `2f0c7305f2904f9cb68d17bc3e3f5582`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:04.004034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-88b8e2a4-f8ea-4de6-b0b7-9e99f5d1cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:04.156284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:04.219441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 848/1722] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:04.260162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:04.279613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278971-3cf9-4027-9695-bafc26a61394 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:04.288487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:04.289564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:04.290983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:04.291481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:04.334033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:04.338534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:04.380101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 875/1723] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:04.592961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8e2a4-f8ea-4de6-b0b7-9e99f5d1cedd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:04.594497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-88b8e2a4-f8ea-4de6-b0b7-9e99f5d1cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:04.776030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:04.777701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:04.838188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8e2a4-f8ea-4de6-b0b7-9e99f5d1cedd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:04.847260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:04.848308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:04.848701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:04.849415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] PATH_INFO: `/v3/projects/577c2658460f4404b7281581975e7543` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:04.851287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577c2658460f4404b7281581975e7543)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:04.853732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:04.983221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9be14-c5e5-4b93-93ec-e1d43a376fee service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:05.009600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577c2658460f4404b7281581975e7543', 'request_id': 'req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.037279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577c2658460f4404b7281581975e7543', 'request_id': 'req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.059228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577c2658460f4404b7281581975e7543', 'request_id': 'req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.061458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:05.119508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] The token cache is being invalidate because project 577c2658460f4404b7281581975e7543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:05.120032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.123394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c881d0e-d293-4136-a36f-6c6d5b6a57f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.136423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 849/1724] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:04 2022] DELETE /identity/v3/projects/577c2658460f4404b7281581975e7543 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:05.140492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee7a9-abfd-4e29-ae19-64e27bc07a75 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:05.140804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee7a9-abfd-4e29-ae19-64e27bc07a75 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:05.151176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bee7a9-abfd-4e29-ae19-64e27bc07a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:05.213842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:05.215417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:05.215917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:05.217498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] PATH_INFO: `/v3/projects/ae7ea38c74814dee99b773c290849875` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:05.219384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7ea38c74814dee99b773c290849875)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:05.227500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:05.339345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7ea38c74814dee99b773c290849875', 'request_id': 'req-e0362d05-51ff-4399-9fe9-6b14414abca4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.343969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e4bee7a9-abfd-4e29-ae19-64e27bc07a75 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:05.345324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e4bee7a9-abfd-4e29-ae19-64e27bc07a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:05.355443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7ea38c74814dee99b773c290849875', 'request_id': 'req-e0362d05-51ff-4399-9fe9-6b14414abca4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.369364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7ea38c74814dee99b773c290849875', 'request_id': 'req-e0362d05-51ff-4399-9fe9-6b14414abca4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.396294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] The token cache is being invalidate because project ae7ea38c74814dee99b773c290849875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:05.396900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.397373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e0362d05-51ff-4399-9fe9-6b14414abca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:05.401496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 876/1725] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:04 2022] DELETE /identity/v3/projects/ae7ea38c74814dee99b773c290849875 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:05.403919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46efd1-28aa-45de-8b13-6b913be03ebb None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:05.405777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46efd1-28aa-45de-8b13-6b913be03ebb None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:05.406188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46efd1-28aa-45de-8b13-6b913be03ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:05.469795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fa46efd1-28aa-45de-8b13-6b913be03ebb None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:05.477622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fa46efd1-28aa-45de-8b13-6b913be03ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:05.481460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:05.535499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 850/1726] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:05.537751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473bd4d-a807-42f8-8f02-d02620b2a672 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:05.538341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473bd4d-a807-42f8-8f02-d02620b2a672 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:05.539233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473bd4d-a807-42f8-8f02-d02620b2a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:05.586060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a473bd4d-a807-42f8-8f02-d02620b2a672 None None] MFA Rules not processed for user `359f2e7aebf74167bf87af802bccdbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:05.588673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a473bd4d-a807-42f8-8f02-d02620b2a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:05.642767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 877/1727] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:05.646216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cf7e-bb2a-458c-9313-72d324c4fd6c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:05.646791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cf7e-bb2a-458c-9313-72d324c4fd6c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:05.648446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cf7e-bb2a-458c-9313-72d324c4fd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:05.732897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8f99cf7e-bb2a-458c-9313-72d324c4fd6c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:05.735132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8f99cf7e-bb2a-458c-9313-72d324c4fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:05.746477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 878/1728] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:05.748074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7260-e917-48fd-a8ce-576da7b4922d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:05.748586 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7260-e917-48fd-a8ce-576da7b4922d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:05.749061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df7260-e917-48fd-a8ce-576da7b4922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:05.832997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-18df7260-e917-48fd-a8ce-576da7b4922d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:05.836299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 851/1729] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:05.845497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-18df7260-e917-48fd-a8ce-576da7b4922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:05.848127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fbf89-f258-4ee3-889a-7493809d1d9a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:05.848950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fbf89-f258-4ee3-889a-7493809d1d9a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:05.849916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fbf89-f258-4ee3-889a-7493809d1d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:05.869225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 879/1730] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:05.877203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df7260-e917-48fd-a8ce-576da7b4922d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:05.884110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-18df7260-e917-48fd-a8ce-576da7b4922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:05.919770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6e1fbf89-f258-4ee3-889a-7493809d1d9a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:05.925170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6e1fbf89-f258-4ee3-889a-7493809d1d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:05.946827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 852/1731] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:05.948043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fbf89-f258-4ee3-889a-7493809d1d9a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:05.981016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fbf89-f258-4ee3-889a-7493809d1d9a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:05.994854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:05.995493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:05.995805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:05.996081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:05.996835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:05.997202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:06.000906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:06.032181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 853/1732] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:06.037409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:06.055751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:06.065885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9c89d-3a1f-4777-8f61-a3aac964ada1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:06.100246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:06.105268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:06.107392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:06.107755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:06.115073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:06.117468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:06.124073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:06.188916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df7260-e917-48fd-a8ce-576da7b4922d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:06.200778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88b994-8f5b-4b46-9b54-5d4dad2ab82e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:06.201471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88b994-8f5b-4b46-9b54-5d4dad2ab82e service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:06.201756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88b994-8f5b-4b46-9b54-5d4dad2ab82e service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:06.202025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88b994-8f5b-4b46-9b54-5d4dad2ab82e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:06.207564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 854/1733] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:06.209273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:06.228720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88b994-8f5b-4b46-9b54-5d4dad2ab82e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:06.231049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88b994-8f5b-4b46-9b54-5d4dad2ab82e service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:06.258957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12339-4f21-4286-91a9-a8eb5d8b505f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:06.258957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:06.258957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:06.258957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:06.259281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:06.259281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:06.259989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:06.276287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 880/1734] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:19:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:19:06.277548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88b994-8f5b-4b46-9b54-5d4dad2ab82e service swift] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:06.299354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 855/1735] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:06 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:06.300669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:06.304718 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:06.307212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88b994-8f5b-4b46-9b54-5d4dad2ab82e service swift] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:06.455937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1a11-1c98-4061-bd31-d322f4f6559d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:06.473428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:06.474417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:06.475020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:06.475865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] PATH_INFO: `/v3/users/fc80909b05c4483298d3cdd3972a7772` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:06.478698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc80909b05c4483298d3cdd3972a7772)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:06.490067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:06.542884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5ba5-cc2f-4afc-9522-87393ad8f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:06.544242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5ba5-cc2f-4afc-9522-87393ad8f4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:06.546384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5ba5-cc2f-4afc-9522-87393ad8f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:06.552611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5ba5-cc2f-4afc-9522-87393ad8f4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:06.554803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c5ba5-cc2f-4afc-9522-87393ad8f4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:06.558796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c5ba5-cc2f-4afc-9522-87393ad8f4fd admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:06.578919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:06.600884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc80909b05c4483298d3cdd3972a7772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:06.654514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc80909b05c4483298d3cdd3972a7772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:06.679166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 881/1736] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:06 2022] POST /identity/v3/projects => generated 383 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:06.681753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc80909b05c4483298d3cdd3972a7772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:06.682211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5ba5-cc2f-4afc-9522-87393ad8f4fd admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:06.705615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc80909b05c4483298d3cdd3972a7772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:06.706592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc80909b05c4483298d3cdd3972a7772'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:06.727839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 856/1737] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:06 2022] DELETE /identity/v3/users/fc80909b05c4483298d3cdd3972a7772 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:06.731734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:06.735282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:06.864589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5ba5-cc2f-4afc-9522-87393ad8f4fd admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:06.929712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a43ba-22f9-47d4-b631-5457fe9b9319 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:06.957383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cea5d5-1c58-4b11-8dfa-0ebc16d2630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:06.958031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cea5d5-1c58-4b11-8dfa-0ebc16d2630c admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:06.959020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cea5d5-1c58-4b11-8dfa-0ebc16d2630c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:06.959020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cea5d5-1c58-4b11-8dfa-0ebc16d2630c admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:06.959275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cea5d5-1c58-4b11-8dfa-0ebc16d2630c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:06.961447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cea5d5-1c58-4b11-8dfa-0ebc16d2630c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:07.050032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 857/1738] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:06 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:07.052721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741955ac-68a0-409e-b2f5-d3532a051bd3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.052721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741955ac-68a0-409e-b2f5-d3532a051bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.053148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741955ac-68a0-409e-b2f5-d3532a051bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.069257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:07.091381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-741955ac-68a0-409e-b2f5-d3532a051bd3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:07.092714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-741955ac-68a0-409e-b2f5-d3532a051bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:07.133068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 858/1739] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:07.135745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741955ac-68a0-409e-b2f5-d3532a051bd3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:07.138135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe911bc-fe35-4e8d-b418-68cdba632bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:07.138834 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe911bc-fe35-4e8d-b418-68cdba632bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.139200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe911bc-fe35-4e8d-b418-68cdba632bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.139532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe911bc-fe35-4e8d-b418-68cdba632bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.140238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe911bc-fe35-4e8d-b418-68cdba632bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:07.142954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe911bc-fe35-4e8d-b418-68cdba632bf3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:07.176660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741955ac-68a0-409e-b2f5-d3532a051bd3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:07.191227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c890-6178-4401-aa39-b884adef47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:07.193104 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c890-6178-4401-aa39-b884adef47ef admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.194142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c890-6178-4401-aa39-b884adef47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.194422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c890-6178-4401-aa39-b884adef47ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.196869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c890-6178-4401-aa39-b884adef47ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:07.209486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c890-6178-4401-aa39-b884adef47ef admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:07.251552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 859/1740] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:07.251552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5167c9-aab0-46a8-a02c-06294b7cb2b1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.251552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5167c9-aab0-46a8-a02c-06294b7cb2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.251552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5167c9-aab0-46a8-a02c-06294b7cb2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.260682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 882/1741] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:06 2022] POST /identity/v3/users => generated 294 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:07.262809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe911bc-fe35-4e8d-b418-68cdba632bf3 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:07.332839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe911bc-fe35-4e8d-b418-68cdba632bf3 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:07.334688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5b5167c9-aab0-46a8-a02c-06294b7cb2b1 None None] MFA Rules not processed for user `9032773d56f84e7c889b189b21803c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:07.352233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5b5167c9-aab0-46a8-a02c-06294b7cb2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:07.355653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:07.356245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.356531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.356806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.357615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:07.376413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:07.433405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 883/1742] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:07.434933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:07.444530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:07.668867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 860/1743] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:07.668867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5167c9-aab0-46a8-a02c-06294b7cb2b1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:07.676783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5b5167c9-aab0-46a8-a02c-06294b7cb2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:07.689885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733c063-2e9d-44bf-8ee6-a4eba508874d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:07.703985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754219f-83da-42c5-a8a5-5e85425dd4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:07.705784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754219f-83da-42c5-a8a5-5e85425dd4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.712417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754219f-83da-42c5-a8a5-5e85425dd4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.712868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754219f-83da-42c5-a8a5-5e85425dd4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.751425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754219f-83da-42c5-a8a5-5e85425dd4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:07.753399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754219f-83da-42c5-a8a5-5e85425dd4a9 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:07.758231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5167c9-aab0-46a8-a02c-06294b7cb2b1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:07.781132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eda4c-9562-46c1-902e-cf1e696a0d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:07.781779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eda4c-9562-46c1-902e-cf1e696a0d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.782059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eda4c-9562-46c1-902e-cf1e696a0d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.782330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eda4c-9562-46c1-902e-cf1e696a0d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.782989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eda4c-9562-46c1-902e-cf1e696a0d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:07.784629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eda4c-9562-46c1-902e-cf1e696a0d3b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:07.786424 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 884/1744] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:07.787426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754219f-83da-42c5-a8a5-5e85425dd4a9 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:07.803727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754219f-83da-42c5-a8a5-5e85425dd4a9 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:07.812119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0d34a-ff3e-465f-81a1-247a601ac191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:07.815554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d34a-ff3e-465f-81a1-247a601ac191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.815554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d34a-ff3e-465f-81a1-247a601ac191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.815554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d34a-ff3e-465f-81a1-247a601ac191 admin admin] PATH_INFO: `/v3/projects/18870c76505d43a398e48aaee8018e9e/users/a75d791156aa4597904215e817b52237/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.849794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0d34a-ff3e-465f-81a1-247a601ac191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18870c76505d43a398e48aaee8018e9e, user_id=a75d791156aa4597904215e817b52237, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:07.854680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0d34a-ff3e-465f-81a1-247a601ac191 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:07.861664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 861/1745] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:07.862616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eda4c-9562-46c1-902e-cf1e696a0d3b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:07.880906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 885/1746] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:07 2022] PUT /identity/v3/projects/18870c76505d43a398e48aaee8018e9e/users/a75d791156aa4597904215e817b52237/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:07.883231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6119-6dd4-4286-8355-78a5d9075269 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:07.883804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6119-6dd4-4286-8355-78a5d9075269 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:07.884158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a6119-6dd4-4286-8355-78a5d9075269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:07.905537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eda4c-9562-46c1-902e-cf1e696a0d3b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:07.929044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:07.980170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ae2a6119-6dd4-4286-8355-78a5d9075269 None None] MFA Rules not processed for user `a75d791156aa4597904215e817b52237`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:07.981513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ae2a6119-6dd4-4286-8355-78a5d9075269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:08.112925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc514-f00f-4e0b-a154-366afdb1f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:08.118280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc514-f00f-4e0b-a154-366afdb1f583 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:08.118523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc514-f00f-4e0b-a154-366afdb1f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:08.118853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffc514-f00f-4e0b-a154-366afdb1f583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:08.122198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffc514-f00f-4e0b-a154-366afdb1f583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:08.130622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffc514-f00f-4e0b-a154-366afdb1f583 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:08.181589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 862/1747] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:08.185812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc514-f00f-4e0b-a154-366afdb1f583 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:08.230696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffc514-f00f-4e0b-a154-366afdb1f583 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:08.245882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d91e8-a803-4b36-8e0d-765377c72f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:08.247049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d91e8-a803-4b36-8e0d-765377c72f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:08.247513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d91e8-a803-4b36-8e0d-765377c72f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:08.247968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d91e8-a803-4b36-8e0d-765377c72f46 admin admin] PATH_INFO: `/v3/projects/0683f7d090d24be48170f69ab9375af8/users/4727beec503f42e898ad2b103cff69c1/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:08.302628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d91e8-a803-4b36-8e0d-765377c72f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0683f7d090d24be48170f69ab9375af8, user_id=4727beec503f42e898ad2b103cff69c1, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:08.314702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d91e8-a803-4b36-8e0d-765377c72f46 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:08.355686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 886/1748] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:08.367923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a6119-6dd4-4286-8355-78a5d9075269 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:08.369582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 863/1749] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:08 2022] PUT /identity/v3/projects/0683f7d090d24be48170f69ab9375af8/users/4727beec503f42e898ad2b103cff69c1/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:08.380511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4a14-8dca-4f76-b406-813c1117f092 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:08.380893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4a14-8dca-4f76-b406-813c1117f092 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:08.381239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a4a14-8dca-4f76-b406-813c1117f092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:08.405299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a6119-6dd4-4286-8355-78a5d9075269 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:08.507192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:08.523669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-736a4a14-8dca-4f76-b406-813c1117f092 None None] MFA Rules not processed for user `4727beec503f42e898ad2b103cff69c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:08.531152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-736a4a14-8dca-4f76-b406-813c1117f092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:08.636158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd1dc-b347-4fc7-88d3-8aea06aba5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:08.637149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd1dc-b347-4fc7-88d3-8aea06aba5cc admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:08.637627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd1dc-b347-4fc7-88d3-8aea06aba5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:08.638135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd1dc-b347-4fc7-88d3-8aea06aba5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:08.638973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd1dc-b347-4fc7-88d3-8aea06aba5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:08.641080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd1dc-b347-4fc7-88d3-8aea06aba5cc admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:08.712277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 887/1750] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:08 2022] POST /identity/v3/projects => generated 381 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:08.716544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73dd58-14da-4cb3-a1d9-dc17387fc01b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:08.717148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73dd58-14da-4cb3-a1d9-dc17387fc01b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:08.717658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73dd58-14da-4cb3-a1d9-dc17387fc01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:08.768369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9e73dd58-14da-4cb3-a1d9-dc17387fc01b None None] MFA Rules not processed for user `45dadcdc0903427ca598dcd0bf06a6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:08.770012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9e73dd58-14da-4cb3-a1d9-dc17387fc01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:08.901748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 864/1751] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 523 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:08.905282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a4a14-8dca-4f76-b406-813c1117f092 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:08.933946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a4a14-8dca-4f76-b406-813c1117f092 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:08.950616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 888/1752] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 31 05:19:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:08.952755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73dd58-14da-4cb3-a1d9-dc17387fc01b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:09.118166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:09.118877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:09.119071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:09.119344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:09.119991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:09.129650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:09.189867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 865/1753] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:08 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:09.189867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:09.203546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73dd58-14da-4cb3-a1d9-dc17387fc01b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:09.205000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:09.228365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80208f2-d750-4d23-a072-14f6bb5f9bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:09.228925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80208f2-d750-4d23-a072-14f6bb5f9bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:09.229040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80208f2-d750-4d23-a072-14f6bb5f9bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:09.229598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80208f2-d750-4d23-a072-14f6bb5f9bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:09.230342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80208f2-d750-4d23-a072-14f6bb5f9bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:09.231904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80208f2-d750-4d23-a072-14f6bb5f9bc1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:09.251330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398fc2-1100-4a12-b050-9cddbadc9ef0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:09.268531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec170-6bb6-45a5-b4be-6f012784e27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:09.269216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec170-6bb6-45a5-b4be-6f012784e27b service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:09.269498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec170-6bb6-45a5-b4be-6f012784e27b service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:09.269771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec170-6bb6-45a5-b4be-6f012784e27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:09.311197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec170-6bb6-45a5-b4be-6f012784e27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:09.312675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec170-6bb6-45a5-b4be-6f012784e27b service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:09.322986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:09.351214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 866/1754] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:09.355081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 889/1755] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:08 2022] POST /identity/v3/projects => generated 385 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:09.360056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80208f2-d750-4d23-a072-14f6bb5f9bc1 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:09.361408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec170-6bb6-45a5-b4be-6f012784e27b service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:09.406196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec170-6bb6-45a5-b4be-6f012784e27b service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:09.539926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:09.578606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80208f2-d750-4d23-a072-14f6bb5f9bc1 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:09.585518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded10dc-a5aa-4e7f-a66a-30d812dd999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:09.586296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded10dc-a5aa-4e7f-a66a-30d812dd999a admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:09.586674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded10dc-a5aa-4e7f-a66a-30d812dd999a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:09.587012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded10dc-a5aa-4e7f-a66a-30d812dd999a admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:09.587892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded10dc-a5aa-4e7f-a66a-30d812dd999a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:09.590882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded10dc-a5aa-4e7f-a66a-30d812dd999a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:09.593714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46241eeb-ec7f-4bd1-ac7a-0d466d019dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:09.594401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241eeb-ec7f-4bd1-ac7a-0d466d019dde admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:09.594682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241eeb-ec7f-4bd1-ac7a-0d466d019dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:09.594952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241eeb-ec7f-4bd1-ac7a-0d466d019dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:09.595700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46241eeb-ec7f-4bd1-ac7a-0d466d019dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:09.597413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46241eeb-ec7f-4bd1-ac7a-0d466d019dde admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:09.626590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 867/1756] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:09.627723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46241eeb-ec7f-4bd1-ac7a-0d466d019dde admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:09.628774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 890/1757] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:09 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:09.635195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded10dc-a5aa-4e7f-a66a-30d812dd999a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:09.649404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46241eeb-ec7f-4bd1-ac7a-0d466d019dde admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:09.658930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff84916-484a-4557-ae38-8f00fda23b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:09.660063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84916-484a-4557-ae38-8f00fda23b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:09.660535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84916-484a-4557-ae38-8f00fda23b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:09.661012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84916-484a-4557-ae38-8f00fda23b4b admin admin] PATH_INFO: `/v3/projects/5da3cab480f643029d63077da15e01c5/users/c161afcd2d734492bac75caa7c1544ae/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:09.679822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded10dc-a5aa-4e7f-a66a-30d812dd999a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:09.708103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aec23b-9f8a-414f-8fc4-722f629e6aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:09.708885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec23b-9f8a-414f-8fc4-722f629e6aac admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:09.711592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec23b-9f8a-414f-8fc4-722f629e6aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:09.711592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec23b-9f8a-414f-8fc4-722f629e6aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:09.713625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aec23b-9f8a-414f-8fc4-722f629e6aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:09.722089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aec23b-9f8a-414f-8fc4-722f629e6aac admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:09.731749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff84916-484a-4557-ae38-8f00fda23b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da3cab480f643029d63077da15e01c5, user_id=c161afcd2d734492bac75caa7c1544ae, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:09.742294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff84916-484a-4557-ae38-8f00fda23b4b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:09.779212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 891/1758] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:09.782503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 868/1759] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:09 2022] PUT /identity/v3/projects/5da3cab480f643029d63077da15e01c5/users/c161afcd2d734492bac75caa7c1544ae/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:09.782648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aec23b-9f8a-414f-8fc4-722f629e6aac admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:09.784457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff84916-484a-4557-ae38-8f00fda23b4b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:09.810089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aec23b-9f8a-414f-8fc4-722f629e6aac admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:10.034594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff84916-484a-4557-ae38-8f00fda23b4b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:10.045549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:10.046956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:10.048477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:10.049992 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:10.051726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:10.069952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:10.095019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb105101-4f4f-4557-8954-7053fbce2e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:10.100079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105101-4f4f-4557-8954-7053fbce2e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:10.101703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105101-4f4f-4557-8954-7053fbce2e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:10.101980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105101-4f4f-4557-8954-7053fbce2e0d admin admin] PATH_INFO: `/v3/projects/f4f2872dcb014b50b1400535d089e96e/users/f0cc752c0775409f883b41cf78865b3c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:10.130117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 869/1760] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:10.136186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:10.141654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:10.185454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb105101-4f4f-4557-8954-7053fbce2e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f2872dcb014b50b1400535d089e96e, user_id=f0cc752c0775409f883b41cf78865b3c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:10.189915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb105101-4f4f-4557-8954-7053fbce2e0d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:10.252837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 892/1761] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:09 2022] PUT /identity/v3/projects/f4f2872dcb014b50b1400535d089e96e/users/f0cc752c0775409f883b41cf78865b3c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:10.253914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb105101-4f4f-4557-8954-7053fbce2e0d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:10.423782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1b260-d9a2-4d24-a539-3f5c7b59d6d1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:10.495335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb105101-4f4f-4557-8954-7053fbce2e0d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:10.511001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d6c07-fac6-4481-8ec1-dda2eb10df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:10.511664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d6c07-fac6-4481-8ec1-dda2eb10df0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:10.511952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d6c07-fac6-4481-8ec1-dda2eb10df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:10.512200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d6c07-fac6-4481-8ec1-dda2eb10df0b admin admin] PATH_INFO: `/v3/projects/5da3cab480f643029d63077da15e01c5/users/c161afcd2d734492bac75caa7c1544ae/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:10.519846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d6c07-fac6-4481-8ec1-dda2eb10df0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da3cab480f643029d63077da15e01c5, user_id=c161afcd2d734492bac75caa7c1544ae, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:10.522514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d6c07-fac6-4481-8ec1-dda2eb10df0b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:10.535665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:10.552739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 893/1762] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:10 2022] PUT /identity/v3/projects/5da3cab480f643029d63077da15e01c5/users/c161afcd2d734492bac75caa7c1544ae/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:10.553758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d6c07-fac6-4481-8ec1-dda2eb10df0b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:10.675406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:10.683162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:10.683162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:10.683162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:10.683162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:10.728106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:10.791011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d6c07-fac6-4481-8ec1-dda2eb10df0b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:10.815016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef866d-12a0-4204-9a24-6f76cad7ef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:10.816829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef866d-12a0-4204-9a24-6f76cad7ef4f admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:10.816829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef866d-12a0-4204-9a24-6f76cad7ef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:10.819682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef866d-12a0-4204-9a24-6f76cad7ef4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:10.824513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef866d-12a0-4204-9a24-6f76cad7ef4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:10.833376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef866d-12a0-4204-9a24-6f76cad7ef4f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:10.880567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 894/1763] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:10.882216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f410a6-9252-4c97-940c-f39d3aec1719 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:10.882470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f410a6-9252-4c97-940c-f39d3aec1719 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:10.882937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f410a6-9252-4c97-940c-f39d3aec1719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:10.936327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:10.940893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:11.003055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 870/1764] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 871 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:11.006130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:11.039721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a9f410a6-9252-4c97-940c-f39d3aec1719 None None] MFA Rules not processed for user `c161afcd2d734492bac75caa7c1544ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:11.040999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a9f410a6-9252-4c97-940c-f39d3aec1719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:11.062479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5f7f7-b2ef-41e6-a5e2-25983a01189a service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:11.084772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252777c7-e185-4a4a-864b-ef70e46d72e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:11.085583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252777c7-e185-4a4a-864b-ef70e46d72e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:11.086075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252777c7-e185-4a4a-864b-ef70e46d72e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:11.089695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252777c7-e185-4a4a-864b-ef70e46d72e2 admin admin] PATH_INFO: `/v3/projects/f4f2872dcb014b50b1400535d089e96e/users/f0cc752c0775409f883b41cf78865b3c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:11.092684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252777c7-e185-4a4a-864b-ef70e46d72e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f2872dcb014b50b1400535d089e96e, user_id=f0cc752c0775409f883b41cf78865b3c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:11.100166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252777c7-e185-4a4a-864b-ef70e46d72e2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:11.181459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 871/1765] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:11 2022] PUT /identity/v3/projects/f4f2872dcb014b50b1400535d089e96e/users/f0cc752c0775409f883b41cf78865b3c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:11.189012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299e9b4-869b-4eb6-b2ca-a714234e0b2e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:11.189254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299e9b4-869b-4eb6-b2ca-a714234e0b2e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:11.189535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299e9b4-869b-4eb6-b2ca-a714234e0b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:11.267270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b299e9b4-869b-4eb6-b2ca-a714234e0b2e None None] MFA Rules not processed for user `f0cc752c0775409f883b41cf78865b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:11.268605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b299e9b4-869b-4eb6-b2ca-a714234e0b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:11.307570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 895/1766] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:11.331156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f410a6-9252-4c97-940c-f39d3aec1719 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:11.332713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a9f410a6-9252-4c97-940c-f39d3aec1719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:11.478846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 872/1767] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:11.517497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f410a6-9252-4c97-940c-f39d3aec1719 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:11.679807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54c89a-82d3-4e09-b59e-786e6cda0065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:11.681543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c89a-82d3-4e09-b59e-786e6cda0065 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:11.683201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c89a-82d3-4e09-b59e-786e6cda0065 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:11.683201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c89a-82d3-4e09-b59e-786e6cda0065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:11.829868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:11.903333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54c89a-82d3-4e09-b59e-786e6cda0065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:11.905559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54c89a-82d3-4e09-b59e-786e6cda0065 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:11.958050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 896/1768] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:12.130178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299e9b4-869b-4eb6-b2ca-a714234e0b2e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:12.153659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299e9b4-869b-4eb6-b2ca-a714234e0b2e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:12.170946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08596-21ea-4bf2-b0ab-65939ab32131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:12.171769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08596-21ea-4bf2-b0ab-65939ab32131 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:12.174336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08596-21ea-4bf2-b0ab-65939ab32131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:12.174637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08596-21ea-4bf2-b0ab-65939ab32131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:12.227356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa08596-21ea-4bf2-b0ab-65939ab32131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:12.228442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa08596-21ea-4bf2-b0ab-65939ab32131 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:12.270506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 873/1769] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:12.615009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54c89a-82d3-4e09-b59e-786e6cda0065 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:12.646903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08596-21ea-4bf2-b0ab-65939ab32131 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:12.664126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08596-21ea-4bf2-b0ab-65939ab32131 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:12.681969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:12.682619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:12.682902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:12.683177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:12.889687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:12.945743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54c89a-82d3-4e09-b59e-786e6cda0065 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:12.979062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:12.983833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:12.985239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:12.994128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] PATH_INFO: `/v3/users/4727beec503f42e898ad2b103cff69c1` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:12.998037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4727beec503f42e898ad2b103cff69c1)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:13.005685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:13.020759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:13.024418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:13.097803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 874/1770] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:13.118864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:13.122568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:13.203245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bca146-3606-4a49-9d80-9fb8bd33bb6f service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:13.228309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:13.228997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:13.231312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:13.233784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] PATH_INFO: `/v3/projects/223b6a1b882247b881bf907744682b62` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:13.248782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=223b6a1b882247b881bf907744682b62)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:13.252095 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:13.255378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4727beec503f42e898ad2b103cff69c1'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.258080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4727beec503f42e898ad2b103cff69c1'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.302912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4727beec503f42e898ad2b103cff69c1'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.331527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4727beec503f42e898ad2b103cff69c1'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.354652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-a878b614-1115-4693-9a6c-5ec0d352674e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4727beec503f42e898ad2b103cff69c1'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.375728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 897/1771] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:12 2022] DELETE /identity/v3/users/4727beec503f42e898ad2b103cff69c1 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:13.381008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf9eee-0038-4db5-b802-c94e422ae37f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:13.382520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf9eee-0038-4db5-b802-c94e422ae37f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:13.383534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf9eee-0038-4db5-b802-c94e422ae37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:13.472427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-14bf9eee-0038-4db5-b802-c94e422ae37f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:13.479653 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-14bf9eee-0038-4db5-b802-c94e422ae37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:13.491231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223b6a1b882247b881bf907744682b62', 'request_id': 'req-a728bc50-7ba1-4584-9473-6a314cd8b80f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.532292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223b6a1b882247b881bf907744682b62', 'request_id': 'req-a728bc50-7ba1-4584-9473-6a314cd8b80f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.555378 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223b6a1b882247b881bf907744682b62', 'request_id': 'req-a728bc50-7ba1-4584-9473-6a314cd8b80f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.618551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] The token cache is being invalidate because project 223b6a1b882247b881bf907744682b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:13.619034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.621813 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a728bc50-7ba1-4584-9473-6a314cd8b80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:13.648282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 875/1772] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:13 2022] DELETE /identity/v3/projects/223b6a1b882247b881bf907744682b62 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:13.654906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5bc57-baed-4272-b5de-06aaf25db1ee None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:13.655549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5bc57-baed-4272-b5de-06aaf25db1ee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:13.656438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5bc57-baed-4272-b5de-06aaf25db1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:13.721729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:13.727158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1bd5bc57-baed-4272-b5de-06aaf25db1ee None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:13.731181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1bd5bc57-baed-4272-b5de-06aaf25db1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:13.763794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 898/1773] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:13.778349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc42eb-fff8-42a6-a4d3-402bab626e45 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:13.779046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc42eb-fff8-42a6-a4d3-402bab626e45 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:13.779531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc42eb-fff8-42a6-a4d3-402bab626e45 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:13.781439 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 899/1774] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:19:13.892923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 876/1775] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:13.895668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ba12-9932-4a39-b16e-350c5ab0b5f6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:13.896294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ba12-9932-4a39-b16e-350c5ab0b5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:13.896807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ba12-9932-4a39-b16e-350c5ab0b5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:13.901778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc91a9-cf12-4f66-9d9c-ecb8bedc004e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:13.903532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc91a9-cf12-4f66-9d9c-ecb8bedc004e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:13.906771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc91a9-cf12-4f66-9d9c-ecb8bedc004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:13.993978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9a02ba12-9932-4a39-b16e-350c5ab0b5f6 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:13.995381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9a02ba12-9932-4a39-b16e-350c5ab0b5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:14.012492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a7cc91a9-cf12-4f66-9d9c-ecb8bedc004e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:14.036627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a7cc91a9-cf12-4f66-9d9c-ecb8bedc004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:14.052815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 877/1776] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:14.054044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc91a9-cf12-4f66-9d9c-ecb8bedc004e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:14.056419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a7cc91a9-cf12-4f66-9d9c-ecb8bedc004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:14.268934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 900/1777] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:19:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:14.270806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ba12-9932-4a39-b16e-350c5ab0b5f6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:14.272355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9a02ba12-9932-4a39-b16e-350c5ab0b5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:14.293722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ba12-9932-4a39-b16e-350c5ab0b5f6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:14.293922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc91a9-cf12-4f66-9d9c-ecb8bedc004e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:14.315311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92aa7e-fb56-478d-8e54-44fdfe5b60c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:14.316937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:14.317648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:14.317938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:14.318211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] PATH_INFO: `/v3/users/a75d791156aa4597904215e817b52237` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:14.318749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92aa7e-fb56-478d-8e54-44fdfe5b60c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:14.319074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92aa7e-fb56-478d-8e54-44fdfe5b60c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:14.319345 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92aa7e-fb56-478d-8e54-44fdfe5b60c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:14.322585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75d791156aa4597904215e817b52237)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:14.324551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:14.334885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:14.353896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92aa7e-fb56-478d-8e54-44fdfe5b60c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:14.355740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92aa7e-fb56-478d-8e54-44fdfe5b60c9 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:14.379787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 878/1778] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:14.381317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92aa7e-fb56-478d-8e54-44fdfe5b60c9 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:14.396797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92aa7e-fb56-478d-8e54-44fdfe5b60c9 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:14.425422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:14.429829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:14.431213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:14.431860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:14.433201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:14.433926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:14.439319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:14.478741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75d791156aa4597904215e817b52237'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:14.480958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75d791156aa4597904215e817b52237'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:14.534414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 879/1779] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:14.535551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:14.545756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:14.555147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75d791156aa4597904215e817b52237'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:14.592103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75d791156aa4597904215e817b52237'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:14.608651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce14fc-037a-4fd0-8b49-aba1b9b1bf05 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:14.611847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75d791156aa4597904215e817b52237'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:14.626471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 901/1780] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:14 2022] DELETE /identity/v3/users/a75d791156aa4597904215e817b52237 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:14.630914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:14.631866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfd435-00c6-4e66-85ff-ca861d476ebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:14.633612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfd435-00c6-4e66-85ff-ca861d476ebb service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:14.634584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:14.635093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfd435-00c6-4e66-85ff-ca861d476ebb service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:14.636826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfd435-00c6-4e66-85ff-ca861d476ebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:14.648607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aedfd435-00c6-4e66-85ff-ca861d476ebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:14.693856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfd435-00c6-4e66-85ff-ca861d476ebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:14.701980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfd435-00c6-4e66-85ff-ca861d476ebb service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:14.773993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 880/1781] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:14.775846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e3dd5-f4ac-4a0c-a716-c29148df310c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:14.777729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e3dd5-f4ac-4a0c-a716-c29148df310c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:14.781975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e3dd5-f4ac-4a0c-a716-c29148df310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:14.848079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3a5e3dd5-f4ac-4a0c-a716-c29148df310c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:14.851901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3a5e3dd5-f4ac-4a0c-a716-c29148df310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:14.895294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:14.927995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f35d18-30da-47fc-ad12-d951ef093086 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:14.944002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094d7e6-4206-457f-becf-645a3a12104b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:14.944673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094d7e6-4206-457f-becf-645a3a12104b admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:14.947898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094d7e6-4206-457f-becf-645a3a12104b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:14.948376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094d7e6-4206-457f-becf-645a3a12104b admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:14.949579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094d7e6-4206-457f-becf-645a3a12104b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:14.952220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094d7e6-4206-457f-becf-645a3a12104b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:15.014665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 902/1782] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:14 2022] POST /identity/v3/projects => generated 363 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:15.019444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094d7e6-4206-457f-becf-645a3a12104b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:15.079330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 881/1783] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:15.159693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094d7e6-4206-457f-becf-645a3a12104b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:15.174984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea45e2-930a-4e4f-9037-99143d2d02cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:15.175919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea45e2-930a-4e4f-9037-99143d2d02cc admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:15.176133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea45e2-930a-4e4f-9037-99143d2d02cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:15.176517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea45e2-930a-4e4f-9037-99143d2d02cc admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:15.177655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea45e2-930a-4e4f-9037-99143d2d02cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:15.181221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea45e2-930a-4e4f-9037-99143d2d02cc admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:15.240428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e3dd5-f4ac-4a0c-a716-c29148df310c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:15.253308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 903/1784] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:15 2022] POST /identity/v3/users => generated 282 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:15.258883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e3dd5-f4ac-4a0c-a716-c29148df310c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:15.264844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc3e5-1c5b-4fa5-b59e-3d19a5b1de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:15.265892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc3e5-1c5b-4fa5-b59e-3d19a5b1de89 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:15.266434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc3e5-1c5b-4fa5-b59e-3d19a5b1de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:15.267001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc3e5-1c5b-4fa5-b59e-3d19a5b1de89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:15.267886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc3e5-1c5b-4fa5-b59e-3d19a5b1de89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:15.269923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc3e5-1c5b-4fa5-b59e-3d19a5b1de89 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:15.287614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 882/1785] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:15.291879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea45e2-930a-4e4f-9037-99143d2d02cc admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:15.311788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea45e2-930a-4e4f-9037-99143d2d02cc admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:15.317651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:15.318410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:15.319407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:15.319407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:15.320094 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:15.322403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:15.346973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 904/1786] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:15.347459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc3e5-1c5b-4fa5-b59e-3d19a5b1de89 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:15.381219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc3e5-1c5b-4fa5-b59e-3d19a5b1de89 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:15.390832 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fab2a-c03a-4b73-9884-4f0c0c8c5444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:15.391509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fab2a-c03a-4b73-9884-4f0c0c8c5444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:15.391789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fab2a-c03a-4b73-9884-4f0c0c8c5444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:15.392056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fab2a-c03a-4b73-9884-4f0c0c8c5444 admin admin] PATH_INFO: `/v3/projects/ebebaab0c3584cc7b52c3f0aaab42da9/users/e6fe8db716b44cd8ba72fbbc4df7360c/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:15.438944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fab2a-c03a-4b73-9884-4f0c0c8c5444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebebaab0c3584cc7b52c3f0aaab42da9, user_id=e6fe8db716b44cd8ba72fbbc4df7360c, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:15.449820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fab2a-c03a-4b73-9884-4f0c0c8c5444 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:15.488088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:15.491524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:15.502482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 883/1787] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:15 2022] PUT /identity/v3/projects/ebebaab0c3584cc7b52c3f0aaab42da9/users/e6fe8db716b44cd8ba72fbbc4df7360c/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:15.526703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cd68d-c6b1-4b56-a445-a3209c54efbf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:15.529060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cd68d-c6b1-4b56-a445-a3209c54efbf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:15.529542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cd68d-c6b1-4b56-a445-a3209c54efbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:15.637474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-909cd68d-c6b1-4b56-a445-a3209c54efbf None None] MFA Rules not processed for user `e6fe8db716b44cd8ba72fbbc4df7360c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:15.638952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-909cd68d-c6b1-4b56-a445-a3209c54efbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:15.771412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9c3d1-f2af-49f5-8c8d-e7fda33d823c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:15.772120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 884/1788] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:15.774473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb77d2-a682-48b4-8fee-6a27ba7eef28 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:15.775239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb77d2-a682-48b4-8fee-6a27ba7eef28 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:15.775864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb77d2-a682-48b4-8fee-6a27ba7eef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:15.824829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c7fb77d2-a682-48b4-8fee-6a27ba7eef28 None None] MFA Rules not processed for user `2f0c7305f2904f9cb68d17bc3e3f5582`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:15.826466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c7fb77d2-a682-48b4-8fee-6a27ba7eef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:15.878487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:16.013807 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 885/1789] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:16.016374 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb77d2-a682-48b4-8fee-6a27ba7eef28 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:16.046049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:16.047447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:16.048549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:16.056033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:16.156034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:16.245739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:16.248299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:16.271234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 905/1790] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:16.272990 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:16.276260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:16.277803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb77d2-a682-48b4-8fee-6a27ba7eef28 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:16.294499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966e7fc-735c-4343-a79b-bf38678615be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:16.295528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966e7fc-735c-4343-a79b-bf38678615be admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:16.295991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966e7fc-735c-4343-a79b-bf38678615be admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:16.296413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966e7fc-735c-4343-a79b-bf38678615be admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:16.297702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966e7fc-735c-4343-a79b-bf38678615be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:16.312297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb9d9e-3762-4035-8b02-aa4ccaac0b5c service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:16.313318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966e7fc-735c-4343-a79b-bf38678615be admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:16.318957 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:16.319879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:16.320355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:16.320717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] PATH_INFO: `/v3/users/aa710e47991e4fbd941a6b2cb5e869c7` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:16.322741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa710e47991e4fbd941a6b2cb5e869c7)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:16.325811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:16.384013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 886/1791] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:16 2022] POST /identity/v3/projects => generated 365 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:16.388311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966e7fc-735c-4343-a79b-bf38678615be admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:16.425514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa710e47991e4fbd941a6b2cb5e869c7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:16.426355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa710e47991e4fbd941a6b2cb5e869c7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:16.479452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa710e47991e4fbd941a6b2cb5e869c7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:16.507203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa710e47991e4fbd941a6b2cb5e869c7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:16.530642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f8953540-227f-4d6e-8e3d-6f0ae1d12541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa710e47991e4fbd941a6b2cb5e869c7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:16.545471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 906/1792] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:16 2022] DELETE /identity/v3/users/aa710e47991e4fbd941a6b2cb5e869c7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:16.552611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6399a0-9d73-45a2-b2db-e7d05c0b7a5c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:16.553064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6399a0-9d73-45a2-b2db-e7d05c0b7a5c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:16.553562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6399a0-9d73-45a2-b2db-e7d05c0b7a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:16.603812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966e7fc-735c-4343-a79b-bf38678615be admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:16.606302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ee6399a0-9d73-45a2-b2db-e7d05c0b7a5c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:16.608240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ee6399a0-9d73-45a2-b2db-e7d05c0b7a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:16.829704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:16.830651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:16.834244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:16.834696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:16.835568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:16.838230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:16.848287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 907/1793] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:16.852659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:16.928361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 887/1794] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:16 2022] POST /identity/v3/users => generated 289 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:16.932675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6399a0-9d73-45a2-b2db-e7d05c0b7a5c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:16.934565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ee6399a0-9d73-45a2-b2db-e7d05c0b7a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:16.960263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6399a0-9d73-45a2-b2db-e7d05c0b7a5c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:16.961258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:16.964512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:16.971930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ae8b3-f66e-4a3c-ba3c-90f1bfba5655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:16.973353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ae8b3-f66e-4a3c-ba3c-90f1bfba5655 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:16.973729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ae8b3-f66e-4a3c-ba3c-90f1bfba5655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:16.974013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ae8b3-f66e-4a3c-ba3c-90f1bfba5655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:16.976915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ae8b3-f66e-4a3c-ba3c-90f1bfba5655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:16.990314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ae8b3-f66e-4a3c-ba3c-90f1bfba5655 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:17.014782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 908/1795] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:17.020654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ae8b3-f66e-4a3c-ba3c-90f1bfba5655 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:17.042823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ae8b3-f66e-4a3c-ba3c-90f1bfba5655 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:17.058710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93aa03-42f5-4799-aa88-e9e26c00d66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:17.059507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aa03-42f5-4799-aa88-e9e26c00d66c admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:17.059792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aa03-42f5-4799-aa88-e9e26c00d66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:17.073486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93aa03-42f5-4799-aa88-e9e26c00d66c admin admin] PATH_INFO: `/v3/projects/461cd25c8b09416e82e020ad4571e510/users/297330c0c4bf40119d28300ab70ac8cb/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:17.108413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3956c-e818-4f63-87a4-726c5a7aa12a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:17.114993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deac85-5a27-4d7c-a3f7-55faec2056bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:17.116651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deac85-5a27-4d7c-a3f7-55faec2056bd service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:17.116872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deac85-5a27-4d7c-a3f7-55faec2056bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:17.117703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deac85-5a27-4d7c-a3f7-55faec2056bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:17.126287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93aa03-42f5-4799-aa88-e9e26c00d66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=461cd25c8b09416e82e020ad4571e510, user_id=297330c0c4bf40119d28300ab70ac8cb, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:17.128988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93aa03-42f5-4799-aa88-e9e26c00d66c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:17.135512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3deac85-5a27-4d7c-a3f7-55faec2056bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:17.137056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3deac85-5a27-4d7c-a3f7-55faec2056bd service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:17.159684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 888/1796] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:17.168659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 909/1797] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:17 2022] PUT /identity/v3/projects/461cd25c8b09416e82e020ad4571e510/users/297330c0c4bf40119d28300ab70ac8cb/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:17.173448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deac85-5a27-4d7c-a3f7-55faec2056bd service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:17.198545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deac85-5a27-4d7c-a3f7-55faec2056bd service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:17.347153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa32300-3b1b-48f8-b3db-94c2ab7811e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:17.347834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32300-3b1b-48f8-b3db-94c2ab7811e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:17.348133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32300-3b1b-48f8-b3db-94c2ab7811e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:17.348401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32300-3b1b-48f8-b3db-94c2ab7811e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:17.349098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa32300-3b1b-48f8-b3db-94c2ab7811e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:17.350894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa32300-3b1b-48f8-b3db-94c2ab7811e6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:17.381022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 889/1798] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:17.383494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93aa03-42f5-4799-aa88-e9e26c00d66c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:17.389366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:17.399375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93aa03-42f5-4799-aa88-e9e26c00d66c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:17.416404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:17.417152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:17.417440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:17.417715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] PATH_INFO: `/v3/projects/461cd25c8b09416e82e020ad4571e510/users/297330c0c4bf40119d28300ab70ac8cb/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:17.426100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=461cd25c8b09416e82e020ad4571e510, user_id=297330c0c4bf40119d28300ab70ac8cb, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:17.428837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:17.457656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 910/1799] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:17 2022] PUT /identity/v3/projects/461cd25c8b09416e82e020ad4571e510/users/297330c0c4bf40119d28300ab70ac8cb/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:17.472280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c01533-ad36-4904-b689-5eed33cf2f56 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:17.472970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c01533-ad36-4904-b689-5eed33cf2f56 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:17.472970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c01533-ad36-4904-b689-5eed33cf2f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:17.527872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-85c01533-ad36-4904-b689-5eed33cf2f56 None None] MFA Rules not processed for user `297330c0c4bf40119d28300ab70ac8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:17.530554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-85c01533-ad36-4904-b689-5eed33cf2f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:17.670733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:17.672585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:17.701877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 890/1800] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:17.709188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c01533-ad36-4904-b689-5eed33cf2f56 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:17.712409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-85c01533-ad36-4904-b689-5eed33cf2f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:17.738503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:17.873523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c01533-ad36-4904-b689-5eed33cf2f56 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:17.896475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8ed6-e6fd-4c3b-a99f-2881ca41de69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:17.897538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8ed6-e6fd-4c3b-a99f-2881ca41de69 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:17.897999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8ed6-e6fd-4c3b-a99f-2881ca41de69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:17.898431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd8ed6-e6fd-4c3b-a99f-2881ca41de69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:17.921644 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8ed6-e6fd-4c3b-a99f-2881ca41de69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:17.923264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd8ed6-e6fd-4c3b-a99f-2881ca41de69 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:17.945889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe55586-a141-42c5-8573-4c43790dfd27 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:17.958128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 891/1801] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:17.997500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:17.998379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:17.998667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:17.998952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] PATH_INFO: `/v3/projects/0683f7d090d24be48170f69ab9375af8` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:18.005325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0683f7d090d24be48170f69ab9375af8)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:18.007922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:18.161694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0683f7d090d24be48170f69ab9375af8', 'request_id': 'req-9f45cf63-0d77-41ab-8420-d47f076168e4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.170280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0683f7d090d24be48170f69ab9375af8', 'request_id': 'req-9f45cf63-0d77-41ab-8420-d47f076168e4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.190903 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0683f7d090d24be48170f69ab9375af8', 'request_id': 'req-9f45cf63-0d77-41ab-8420-d47f076168e4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.223645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] The token cache is being invalidate because project 0683f7d090d24be48170f69ab9375af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:18.237639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.243180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.252108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 911/1802] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:17 2022] DELETE /identity/v3/projects/0683f7d090d24be48170f69ab9375af8 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:18.256461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8ed6-e6fd-4c3b-a99f-2881ca41de69 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:18.277344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd8ed6-e6fd-4c3b-a99f-2881ca41de69 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:18.489327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:18.490381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:18.490775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:18.494056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] PATH_INFO: `/v3/users/f0cc752c0775409f883b41cf78865b3c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:18.504768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0cc752c0775409f883b41cf78865b3c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:18.509396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:18.784774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0cc752c0775409f883b41cf78865b3c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.859680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0cc752c0775409f883b41cf78865b3c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.907742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0cc752c0775409f883b41cf78865b3c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.949333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0cc752c0775409f883b41cf78865b3c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.950653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0cc752c0775409f883b41cf78865b3c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:18.987884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 892/1803] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:18 2022] DELETE /identity/v3/users/f0cc752c0775409f883b41cf78865b3c => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:19.134907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:19.136451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:19.150729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45cf63-0d77-41ab-8420-d47f076168e4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:19.246011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:19.247887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:19.270049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:19.270802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:19.271243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:19.271905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] PATH_INFO: `/v3/users/e6fe8db716b44cd8ba72fbbc4df7360c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:19.273598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fe8db716b44cd8ba72fbbc4df7360c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:19.276207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:19.311783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:19.357716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:19.385486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fe8db716b44cd8ba72fbbc4df7360c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.387333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fe8db716b44cd8ba72fbbc4df7360c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.418113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fe8db716b44cd8ba72fbbc4df7360c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.423133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664863c-fa6b-4120-be79-63e85b3f180a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:19.432769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:19.434650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fe8db716b44cd8ba72fbbc4df7360c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.435562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:19.435856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:19.436127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] PATH_INFO: `/v3/projects/18870c76505d43a398e48aaee8018e9e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:19.438615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=18870c76505d43a398e48aaee8018e9e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:19.447688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:19.452005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-be74c27b-269d-452c-b873-d2ecb8ea1e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fe8db716b44cd8ba72fbbc4df7360c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.482703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 912/1804] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:19 2022] DELETE /identity/v3/users/e6fe8db716b44cd8ba72fbbc4df7360c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:19.489339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292649fe-95df-4638-b5d4-587e77e13c6f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:19.489967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292649fe-95df-4638-b5d4-587e77e13c6f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:19.489967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292649fe-95df-4638-b5d4-587e77e13c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:19.554356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-292649fe-95df-4638-b5d4-587e77e13c6f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:19.555547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-292649fe-95df-4638-b5d4-587e77e13c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:19.599058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18870c76505d43a398e48aaee8018e9e', 'request_id': 'req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.617008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18870c76505d43a398e48aaee8018e9e', 'request_id': 'req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.631198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18870c76505d43a398e48aaee8018e9e', 'request_id': 'req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.663969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] The token cache is being invalidate because project 18870c76505d43a398e48aaee8018e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:19.664282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.668661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:19.701853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 893/1805] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:19 2022] DELETE /identity/v3/projects/18870c76505d43a398e48aaee8018e9e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:19.707044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:19.712614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:19.802809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 913/1806] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:19.918318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292649fe-95df-4638-b5d4-587e77e13c6f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:19.918318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-292649fe-95df-4638-b5d4-587e77e13c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:19.950331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e816a-a964-4d4a-9ed5-59e5f8feb43d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:19.961185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:19.962007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:19.962361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:19.962750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] PATH_INFO: `/v3/users/c161afcd2d734492bac75caa7c1544ae` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:19.964907 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] RBAC: Authorizing `identity:delete_user(user_id=c161afcd2d734492bac75caa7c1544ae)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:19.967585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:20.139342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c161afcd2d734492bac75caa7c1544ae'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:20.171500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292649fe-95df-4638-b5d4-587e77e13c6f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:20.186028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:20.187078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:20.189668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c161afcd2d734492bac75caa7c1544ae'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:20.190757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:20.191644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:20.199342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:20.219428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c161afcd2d734492bac75caa7c1544ae'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:20.230577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:20.237456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:20.245809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c161afcd2d734492bac75caa7c1544ae'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:20.246843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c161afcd2d734492bac75caa7c1544ae'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:20.272188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 894/1807] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:19 2022] DELETE /identity/v3/users/c161afcd2d734492bac75caa7c1544ae => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:20.284987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 914/1808] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:20.575173 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:20.576786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:20.807285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ba0af-c2a0-4648-9bbb-9129bb5567da admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:20.818947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:20.819616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:20.819915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:20.820751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] PATH_INFO: `/v3/projects/c3ca9033c6b641f29fcbc0f5f0d8891c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:20.825868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ca9033c6b641f29fcbc0f5f0d8891c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:20.831553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:20.969721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ca9033c6b641f29fcbc0f5f0d8891c', 'request_id': 'req-4f77e527-0415-43f7-adb7-88fda18a96fe'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.009017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ca9033c6b641f29fcbc0f5f0d8891c', 'request_id': 'req-4f77e527-0415-43f7-adb7-88fda18a96fe'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.030027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ca9033c6b641f29fcbc0f5f0d8891c', 'request_id': 'req-4f77e527-0415-43f7-adb7-88fda18a96fe'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.051122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] The token cache is being invalidate because project c3ca9033c6b641f29fcbc0f5f0d8891c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:21.052101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.053678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.061481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 895/1809] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:20 2022] DELETE /identity/v3/projects/c3ca9033c6b641f29fcbc0f5f0d8891c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:21.065381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:21.067634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:21.114286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128315-f8fd-41d8-8dd0-2cebf42daca4 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:21.220693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:21.271267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:21.271858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:21.272157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:21.272432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] PATH_INFO: `/v3/users/0f3fd48302c249f785b74aa63a1e70aa` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:21.273808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3fd48302c249f785b74aa63a1e70aa)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:21.276055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:21.453600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3fd48302c249f785b74aa63a1e70aa'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.454324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3fd48302c249f785b74aa63a1e70aa'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.484964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3fd48302c249f785b74aa63a1e70aa'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.508869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3fd48302c249f785b74aa63a1e70aa'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.527517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2b44c235-1b10-4b98-8bde-77314074136e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3fd48302c249f785b74aa63a1e70aa'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:21.559085 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 915/1810] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:21 2022] DELETE /identity/v3/users/0f3fd48302c249f785b74aa63a1e70aa => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:21.837338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:21.838972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:21.885923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77e527-0415-43f7-adb7-88fda18a96fe admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:22.059037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:22.059710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.060105 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.060524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] PATH_INFO: `/v3/projects/f4f2872dcb014b50b1400535d089e96e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.062237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f2872dcb014b50b1400535d089e96e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:22.065405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:22.099055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:22.187217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f2872dcb014b50b1400535d089e96e', 'request_id': 'req-66bd4c81-ddf6-4e00-a581-b87361998706'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.197522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f2872dcb014b50b1400535d089e96e', 'request_id': 'req-66bd4c81-ddf6-4e00-a581-b87361998706'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.207477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f2872dcb014b50b1400535d089e96e', 'request_id': 'req-66bd4c81-ddf6-4e00-a581-b87361998706'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.222131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] The token cache is being invalidate because project f4f2872dcb014b50b1400535d089e96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:22.222717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.223235 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-66bd4c81-ddf6-4e00-a581-b87361998706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.225135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 896/1811] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:21 2022] DELETE /identity/v3/projects/f4f2872dcb014b50b1400535d089e96e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:22.230023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff674492-39c9-47f9-84d5-5cda38c6879b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.230313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff674492-39c9-47f9-84d5-5cda38c6879b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.230589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff674492-39c9-47f9-84d5-5cda38c6879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.247354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127153c4-606f-4941-b83c-cc5a36385c4f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.247700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127153c4-606f-4941-b83c-cc5a36385c4f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.247930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127153c4-606f-4941-b83c-cc5a36385c4f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.250049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 897/1812] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:19:22.256422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ff674492-39c9-47f9-84d5-5cda38c6879b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:22.257965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ff674492-39c9-47f9-84d5-5cda38c6879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:22.264312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b20d-920e-479f-9776-cdc980926174 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.264886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b20d-920e-479f-9776-cdc980926174 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.265624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9b20d-920e-479f-9776-cdc980926174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.295957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b9f9b20d-920e-479f-9776-cdc980926174 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:22.298026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b9f9b20d-920e-479f-9776-cdc980926174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:22.350421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 916/1813] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:22.359910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578536-9d46-4fc0-84c9-08602302d78e None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.360027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578536-9d46-4fc0-84c9-08602302d78e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.360304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578536-9d46-4fc0-84c9-08602302d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.393403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b2578536-9d46-4fc0-84c9-08602302d78e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:22.395327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b2578536-9d46-4fc0-84c9-08602302d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:22.413704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 917/1814] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:22.415137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 898/1815] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:19:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:22.416248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9b20d-920e-479f-9776-cdc980926174 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:22.420250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578536-9d46-4fc0-84c9-08602302d78e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:22.421973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b2578536-9d46-4fc0-84c9-08602302d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:22.429707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9b20d-920e-479f-9776-cdc980926174 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:22.435231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:22.435864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.436144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.436418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.437311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:22.437569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578536-9d46-4fc0-84c9-08602302d78e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:22.437688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:22.439217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:22.442747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:22.443590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.443927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.444257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] PATH_INFO: `/v3/projects/5da3cab480f643029d63077da15e01c5` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.445577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da3cab480f643029d63077da15e01c5)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:22.447828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:22.455757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 899/1816] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:22.459576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:22.487945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0222c-5403-4bbe-a28b-49a2b12929cc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:22.498628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cce4a5-0839-47be-9759-4b946ffd9ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:22.499273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cce4a5-0839-47be-9759-4b946ffd9ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.500857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cce4a5-0839-47be-9759-4b946ffd9ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.500972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cce4a5-0839-47be-9759-4b946ffd9ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.502880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cce4a5-0839-47be-9759-4b946ffd9ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:22.509560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cce4a5-0839-47be-9759-4b946ffd9ca1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:22.575891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 900/1817] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:22 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:22.579780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cce4a5-0839-47be-9759-4b946ffd9ca1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:22.593255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da3cab480f643029d63077da15e01c5', 'request_id': 'req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.597266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:22.619286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da3cab480f643029d63077da15e01c5', 'request_id': 'req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.637044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da3cab480f643029d63077da15e01c5', 'request_id': 'req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.655541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] The token cache is being invalidate because project 5da3cab480f643029d63077da15e01c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:22.656395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.659324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.662920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 918/1818] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:22 2022] DELETE /identity/v3/projects/5da3cab480f643029d63077da15e01c5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:22.664132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:22.670074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:22.731209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cce4a5-0839-47be-9759-4b946ffd9ca1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:22.750697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:22.752302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.752796 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.753556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.755613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:22.759138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:22.783124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:22.807763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 901/1819] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:22 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:22.807763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:22.810391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:22.814941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3dabe-0cd4-4d52-b282-9ae42e22dcf0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:22.832915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:22.833692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.833973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.834246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] PATH_INFO: `/v3/projects/ebebaab0c3584cc7b52c3f0aaab42da9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:22.840127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebebaab0c3584cc7b52c3f0aaab42da9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:22.846450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:22.917638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebebaab0c3584cc7b52c3f0aaab42da9', 'request_id': 'req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.934829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebebaab0c3584cc7b52c3f0aaab42da9', 'request_id': 'req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.936216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d0b5-a4e8-4f84-92ec-5b272453d1d8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:22.943495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebebaab0c3584cc7b52c3f0aaab42da9', 'request_id': 'req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.964227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] The token cache is being invalidate because project ebebaab0c3584cc7b52c3f0aaab42da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:22.964536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.965856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c66c5ad8-da2e-47f2-bef0-9d7c53bdcc86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:22.967569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 919/1820] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:22 2022] DELETE /identity/v3/projects/ebebaab0c3584cc7b52c3f0aaab42da9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:22.973266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38e971-5b24-47f0-8eea-04a28bb467f8 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:22.973552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38e971-5b24-47f0-8eea-04a28bb467f8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:22.973832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38e971-5b24-47f0-8eea-04a28bb467f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.005118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ec38e971-5b24-47f0-8eea-04a28bb467f8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:23.006465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ec38e971-5b24-47f0-8eea-04a28bb467f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.045769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.046691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.047208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.047754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.050382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.070304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.072360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.087433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 920/1821] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:23.088318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 902/1822] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:23.089312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.090763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.100814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38e971-5b24-47f0-8eea-04a28bb467f8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.103315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ec38e971-5b24-47f0-8eea-04a28bb467f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.110393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a2606-3ff5-4075-b675-e922735d68e2 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.116380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.117547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.117953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.118305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] PATH_INFO: `/v3/projects/662f94a103bf4484b3fbf3ca0c79a6a5` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.119821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662f94a103bf4484b3fbf3ca0c79a6a5)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.122007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.131529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38e971-5b24-47f0-8eea-04a28bb467f8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.138922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.139998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.140840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.141312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.142118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.143927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.148895 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:23.160416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 921/1823] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:23.161331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.165340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.188982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a562-64a8-46af-9447-8aa88ef862e9 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.192345 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662f94a103bf4484b3fbf3ca0c79a6a5', 'request_id': 'req-b30bbc2b-76c5-4421-b01c-b978c177f9a0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.202028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662f94a103bf4484b3fbf3ca0c79a6a5', 'request_id': 'req-b30bbc2b-76c5-4421-b01c-b978c177f9a0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.209171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662f94a103bf4484b3fbf3ca0c79a6a5', 'request_id': 'req-b30bbc2b-76c5-4421-b01c-b978c177f9a0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.217743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:23.222723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] The token cache is being invalidate because project 662f94a103bf4484b3fbf3ca0c79a6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:23.223075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.223959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b30bbc2b-76c5-4421-b01c-b978c177f9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.226190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 903/1824] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:23 2022] DELETE /identity/v3/projects/662f94a103bf4484b3fbf3ca0c79a6a5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:23.227728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006214a-f65e-4b4b-99bc-601bd8e44496 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.228010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006214a-f65e-4b4b-99bc-601bd8e44496 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.228289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006214a-f65e-4b4b-99bc-601bd8e44496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.252084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3006214a-f65e-4b4b-99bc-601bd8e44496 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:23.253488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3006214a-f65e-4b4b-99bc-601bd8e44496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.259156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.259915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.260285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.260712 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] PATH_INFO: `/v3/users/297330c0c4bf40119d28300ab70ac8cb` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.262130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297330c0c4bf40119d28300ab70ac8cb)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.262956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 904/1825] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:23.263870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006214a-f65e-4b4b-99bc-601bd8e44496 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.264418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.265474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3006214a-f65e-4b4b-99bc-601bd8e44496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.278471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006214a-f65e-4b4b-99bc-601bd8e44496 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.283530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.284146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.284416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.284682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.285371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.287037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.298034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 905/1826] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:23.298934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.303444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.314062 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87f12-9e9c-4efe-a085-b78d9f0b8bdc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.319014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.319730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.320102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.320383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] PATH_INFO: `/v3/users/542f37bb0378494a86ee4cd544281f11` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.321563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=542f37bb0378494a86ee4cd544281f11)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.322699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297330c0c4bf40119d28300ab70ac8cb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.323412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297330c0c4bf40119d28300ab70ac8cb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.323706 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.336836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297330c0c4bf40119d28300ab70ac8cb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.343826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297330c0c4bf40119d28300ab70ac8cb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.352101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297330c0c4bf40119d28300ab70ac8cb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.363406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 922/1827] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:23 2022] DELETE /identity/v3/users/297330c0c4bf40119d28300ab70ac8cb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:23.363406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.363406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.377732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542f37bb0378494a86ee4cd544281f11'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.391592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542f37bb0378494a86ee4cd544281f11'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.399105 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542f37bb0378494a86ee4cd544281f11'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.410339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542f37bb0378494a86ee4cd544281f11'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.411596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542f37bb0378494a86ee4cd544281f11'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:23.419935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 906/1828] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:23 2022] DELETE /identity/v3/users/542f37bb0378494a86ee4cd544281f11 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:23.421135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.422499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.444722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f9337-7dad-479c-94c7-10364844eed3 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.468416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:23.502276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a1074-23b0-4ce8-b4c1-aa3bea81e28f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.508785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e43e1-db66-4806-a2b4-4c79713559ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.509600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e43e1-db66-4806-a2b4-4c79713559ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.509968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e43e1-db66-4806-a2b4-4c79713559ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.510273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e43e1-db66-4806-a2b4-4c79713559ee admin admin] PATH_INFO: `/v3/projects/0c4ff15232fe4e14bb2b728c1966ad8d/users/16b6b10d0ea640bcbad1fb7bc9efd94d/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.532048 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e43e1-db66-4806-a2b4-4c79713559ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4ff15232fe4e14bb2b728c1966ad8d, user_id=16b6b10d0ea640bcbad1fb7bc9efd94d, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.539075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.539856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.540145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.540804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.541559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:23.542107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.543791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.550597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e43e1-db66-4806-a2b4-4c79713559ee admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.572177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 923/1829] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:23.576973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.579808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.579969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 907/1830] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:23 2022] PUT /identity/v3/projects/0c4ff15232fe4e14bb2b728c1966ad8d/users/16b6b10d0ea640bcbad1fb7bc9efd94d/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:23.592643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ba981-1221-4443-a363-9b9aedd5fb77 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.592929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ba981-1221-4443-a363-9b9aedd5fb77 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.593226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ba981-1221-4443-a363-9b9aedd5fb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.617640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31120ab4-e7a7-4a2c-a7d9-fb8de949ee08 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.675035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2f2ba981-1221-4443-a363-9b9aedd5fb77 None None] MFA Rules not processed for user `16b6b10d0ea640bcbad1fb7bc9efd94d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:23.676280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2f2ba981-1221-4443-a363-9b9aedd5fb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:23.722271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:23.754806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18828a-bdef-4f4b-8983-632476649bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.755426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18828a-bdef-4f4b-8983-632476649bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.758741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18828a-bdef-4f4b-8983-632476649bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.759129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18828a-bdef-4f4b-8983-632476649bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.759824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18828a-bdef-4f4b-8983-632476649bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.761802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18828a-bdef-4f4b-8983-632476649bf0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.773002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 908/1831] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:23.777871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ba981-1221-4443-a363-9b9aedd5fb77 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.794374 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ba981-1221-4443-a363-9b9aedd5fb77 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:23.804541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 924/1832] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:23 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:23.806827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18828a-bdef-4f4b-8983-632476649bf0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.813436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7e198-b82c-494d-9287-f4ab516bb288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:23.814101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e198-b82c-494d-9287-f4ab516bb288 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:23.814338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e198-b82c-494d-9287-f4ab516bb288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:23.814599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7e198-b82c-494d-9287-f4ab516bb288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:23.815242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7e198-b82c-494d-9287-f4ab516bb288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:23.819333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7e198-b82c-494d-9287-f4ab516bb288 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:23.880663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 909/1833] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:23 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:23.884649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7e198-b82c-494d-9287-f4ab516bb288 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:23.964825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18828a-bdef-4f4b-8983-632476649bf0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.039094 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:24.059242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7e198-b82c-494d-9287-f4ab516bb288 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.064109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59364db2-d95b-42e2-a558-5dbfd6b0f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.064921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59364db2-d95b-42e2-a558-5dbfd6b0f07d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.065292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59364db2-d95b-42e2-a558-5dbfd6b0f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.065736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59364db2-d95b-42e2-a558-5dbfd6b0f07d admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.066529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59364db2-d95b-42e2-a558-5dbfd6b0f07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.068651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59364db2-d95b-42e2-a558-5dbfd6b0f07d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.097611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.099060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.101986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.101986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.101986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.106849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 910/1834] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:23 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:24.107053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.108959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59364db2-d95b-42e2-a558-5dbfd6b0f07d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.138792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59364db2-d95b-42e2-a558-5dbfd6b0f07d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.146565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 925/1835] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:23 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:24.146656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317b607-810c-4015-9270-c23fa5e8f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.146746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.146818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b607-810c-4015-9270-c23fa5e8f4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.146818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b607-810c-4015-9270-c23fa5e8f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.146818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317b607-810c-4015-9270-c23fa5e8f4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.146818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317b607-810c-4015-9270-c23fa5e8f4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.147083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.147581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317b607-810c-4015-9270-c23fa5e8f4c1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.162184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb203db-aa4e-4f2d-bdcd-ac1b550f14ac admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.167234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.167887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.168160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.168540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] PATH_INFO: `/v3/projects/461cd25c8b09416e82e020ad4571e510` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.170004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461cd25c8b09416e82e020ad4571e510)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.172675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.190620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 911/1836] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:24.193364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317b607-810c-4015-9270-c23fa5e8f4c1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.216828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317b607-810c-4015-9270-c23fa5e8f4c1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.225440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83489-3a06-4af2-978e-a70b7baf71d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.226638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83489-3a06-4af2-978e-a70b7baf71d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.227063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83489-3a06-4af2-978e-a70b7baf71d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.227515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af83489-3a06-4af2-978e-a70b7baf71d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.228594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83489-3a06-4af2-978e-a70b7baf71d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.231011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af83489-3a06-4af2-978e-a70b7baf71d0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.264773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461cd25c8b09416e82e020ad4571e510', 'request_id': 'req-4b7a9d83-d585-48a0-933b-173b40c053c6'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.270284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 912/1837] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:24.271302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83489-3a06-4af2-978e-a70b7baf71d0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.274784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461cd25c8b09416e82e020ad4571e510', 'request_id': 'req-4b7a9d83-d585-48a0-933b-173b40c053c6'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.282619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461cd25c8b09416e82e020ad4571e510', 'request_id': 'req-4b7a9d83-d585-48a0-933b-173b40c053c6'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.290770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af83489-3a06-4af2-978e-a70b7baf71d0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.302801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] The token cache is being invalidate because project 461cd25c8b09416e82e020ad4571e510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:24.304806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.309799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.312279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 926/1838] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:24 2022] DELETE /identity/v3/projects/461cd25c8b09416e82e020ad4571e510 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:24.313584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.318838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.386748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14df2c-6c71-462d-924d-592d5ef24eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.387778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14df2c-6c71-462d-924d-592d5ef24eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.388296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14df2c-6c71-462d-924d-592d5ef24eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.388772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14df2c-6c71-462d-924d-592d5ef24eb8 admin admin] PATH_INFO: `/v3/projects/702faa01bc4344c1bf9d880f1e7d5489/users/7063c746ab8a4ec6b9eab60ad2ece156/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.441717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14df2c-6c71-462d-924d-592d5ef24eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702faa01bc4344c1bf9d880f1e7d5489, user_id=7063c746ab8a4ec6b9eab60ad2ece156, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.444831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14df2c-6c71-462d-924d-592d5ef24eb8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.445561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a9d83-d585-48a0-933b-173b40c053c6 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.449723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:24.467905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 913/1839] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:24 2022] PUT /identity/v3/projects/702faa01bc4344c1bf9d880f1e7d5489/users/7063c746ab8a4ec6b9eab60ad2ece156/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:24.469466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e962da-a106-4dbb-9d6a-b3b57daf9181 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.469798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e962da-a106-4dbb-9d6a-b3b57daf9181 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.470078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e962da-a106-4dbb-9d6a-b3b57daf9181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.470393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.471963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.472447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.473441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.474460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.476725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.489179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 927/1840] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:24.490425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.492399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.497032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-18e962da-a106-4dbb-9d6a-b3b57daf9181 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:24.498504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-18e962da-a106-4dbb-9d6a-b3b57daf9181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.518420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6cdb-ca5e-4ac2-b661-ec08e8f2f250 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.585068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 914/1841] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:24.586383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e962da-a106-4dbb-9d6a-b3b57daf9181 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.592011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-18e962da-a106-4dbb-9d6a-b3b57daf9181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.605529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.606333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.606704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.607199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] PATH_INFO: `/v3/projects/d73091917deb43f69bb2e45afcd63820` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.608481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73091917deb43f69bb2e45afcd63820)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.610605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.611547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e962da-a106-4dbb-9d6a-b3b57daf9181 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.619057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:24.626447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304709b-5755-4e20-9594-91b1e36712ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.627894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304709b-5755-4e20-9594-91b1e36712ee admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.630077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304709b-5755-4e20-9594-91b1e36712ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.630739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304709b-5755-4e20-9594-91b1e36712ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.631740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304709b-5755-4e20-9594-91b1e36712ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.635277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304709b-5755-4e20-9594-91b1e36712ee admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.663019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 915/1842] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:24.664734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304709b-5755-4e20-9594-91b1e36712ee admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.686682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304709b-5755-4e20-9594-91b1e36712ee admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.702047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73091917deb43f69bb2e45afcd63820', 'request_id': 'req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.711896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73091917deb43f69bb2e45afcd63820', 'request_id': 'req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.720172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73091917deb43f69bb2e45afcd63820', 'request_id': 'req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.737135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] The token cache is being invalidate because project d73091917deb43f69bb2e45afcd63820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:24.737579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.738348 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-dbd2ed00-c337-4947-a8b6-a58ebbea29e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:24.744972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 928/1843] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:24 2022] DELETE /identity/v3/projects/d73091917deb43f69bb2e45afcd63820 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:24.744972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03093aa-bd6c-4779-98e4-89121b1357a7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.744972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03093aa-bd6c-4779-98e4-89121b1357a7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.744972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03093aa-bd6c-4779-98e4-89121b1357a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.768424 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f03093aa-bd6c-4779-98e4-89121b1357a7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:24.769983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f03093aa-bd6c-4779-98e4-89121b1357a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.771509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e1add-3832-4b78-b1e4-a0c1516a1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.772478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1add-3832-4b78-b1e4-a0c1516a1b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.772933 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1add-3832-4b78-b1e4-a0c1516a1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.773457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e1add-3832-4b78-b1e4-a0c1516a1b2c admin admin] PATH_INFO: `/v3/projects/cebdcbb6c4284e499896dcd033453d99/users/8254f9f1524c492d86b42f8e7efb51a3/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.785224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 929/1844] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:24.785224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03093aa-bd6c-4779-98e4-89121b1357a7 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.786616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f03093aa-bd6c-4779-98e4-89121b1357a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.801684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03093aa-bd6c-4779-98e4-89121b1357a7 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.804643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e1add-3832-4b78-b1e4-a0c1516a1b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebdcbb6c4284e499896dcd033453d99, user_id=8254f9f1524c492d86b42f8e7efb51a3, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.807503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e1add-3832-4b78-b1e4-a0c1516a1b2c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.808462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8510488-1f49-4acc-b249-8044464dcb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.809645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8510488-1f49-4acc-b249-8044464dcb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.809924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8510488-1f49-4acc-b249-8044464dcb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.810193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8510488-1f49-4acc-b249-8044464dcb6d admin admin] PATH_INFO: `/v3/projects/702faa01bc4344c1bf9d880f1e7d5489/users/7063c746ab8a4ec6b9eab60ad2ece156/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.821486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8510488-1f49-4acc-b249-8044464dcb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=702faa01bc4344c1bf9d880f1e7d5489, user_id=7063c746ab8a4ec6b9eab60ad2ece156, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.821486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8510488-1f49-4acc-b249-8044464dcb6d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.827986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 916/1845] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:24 2022] PUT /identity/v3/projects/cebdcbb6c4284e499896dcd033453d99/users/8254f9f1524c492d86b42f8e7efb51a3/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:24.829322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218f91-19c0-4e7a-bfac-c66c5dd8a8d8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.829606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218f91-19c0-4e7a-bfac-c66c5dd8a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.829877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87218f91-19c0-4e7a-bfac-c66c5dd8a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.837389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 930/1846] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:24 2022] PUT /identity/v3/projects/702faa01bc4344c1bf9d880f1e7d5489/users/7063c746ab8a4ec6b9eab60ad2ece156/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:24.838774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8510488-1f49-4acc-b249-8044464dcb6d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:24.852680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-87218f91-19c0-4e7a-bfac-c66c5dd8a8d8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:24.854264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-87218f91-19c0-4e7a-bfac-c66c5dd8a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.914000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8510488-1f49-4acc-b249-8044464dcb6d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:24.919234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104c2a9-ff89-4127-a3f5-22c147750830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:24.919940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c2a9-ff89-4127-a3f5-22c147750830 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.920216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c2a9-ff89-4127-a3f5-22c147750830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.920482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104c2a9-ff89-4127-a3f5-22c147750830 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.927939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 917/1847] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:24.928285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c2a9-ff89-4127-a3f5-22c147750830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:24.928285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c2a9-ff89-4127-a3f5-22c147750830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:24.928467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5924-6b5c-4020-adb1-2bbedc32e0a3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.928467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5924-6b5c-4020-adb1-2bbedc32e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.928467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a5924-6b5c-4020-adb1-2bbedc32e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.928886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104c2a9-ff89-4127-a3f5-22c147750830 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:24.940177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 931/1848] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:24.941763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:24.943604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715ed4-6b69-4492-af57-abe2a53734ae None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:24.944249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715ed4-6b69-4492-af57-abe2a53734ae None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:24.944762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715ed4-6b69-4492-af57-abe2a53734ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:24.963396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-eb6a5924-6b5c-4020-adb1-2bbedc32e0a3 None None] MFA Rules not processed for user `8254f9f1524c492d86b42f8e7efb51a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:24.964818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-eb6a5924-6b5c-4020-adb1-2bbedc32e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:24.975451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-84715ed4-6b69-4492-af57-abe2a53734ae None None] MFA Rules not processed for user `7063c746ab8a4ec6b9eab60ad2ece156`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:24.976906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-84715ed4-6b69-4492-af57-abe2a53734ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:25.037285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:25.045678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 918/1849] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:25.047160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd84d3-c679-4ba5-b070-a3894ed6a490 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.047887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd84d3-c679-4ba5-b070-a3894ed6a490 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.048178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd84d3-c679-4ba5-b070-a3894ed6a490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.064973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 932/1850] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:25.066096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715ed4-6b69-4492-af57-abe2a53734ae None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.071964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-66fd84d3-c679-4ba5-b070-a3894ed6a490 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:25.073428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-66fd84d3-c679-4ba5-b070-a3894ed6a490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:25.079590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715ed4-6b69-4492-af57-abe2a53734ae None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.082558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 919/1851] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:25.085728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.086773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.086956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd84d3-c679-4ba5-b070-a3894ed6a490 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.087230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.087647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.088415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.090672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.098077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd84d3-c679-4ba5-b070-a3894ed6a490 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.116146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.116801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.118018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.118287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.119734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:25.120121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.121923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.138053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 933/1852] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:25 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:25.138827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.142596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:25.154997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 920/1853] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:19:25.154997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.155946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:25.227799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dca66c-edee-424d-bf81-4d9cbf98abba admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.232470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bdb53-8e41-4b3b-bdbd-2b29851df943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.233891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bdb53-8e41-4b3b-bdbd-2b29851df943 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.234481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bdb53-8e41-4b3b-bdbd-2b29851df943 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.234936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bdb53-8e41-4b3b-bdbd-2b29851df943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.238053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960f3d5-2160-4bc8-9500-d9946f087a43 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.247699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a29c9-3094-4169-8d9d-7ffd3df46500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.248799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a29c9-3094-4169-8d9d-7ffd3df46500 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.249314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a29c9-3094-4169-8d9d-7ffd3df46500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.250244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a29c9-3094-4169-8d9d-7ffd3df46500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.322510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bdb53-8e41-4b3b-bdbd-2b29851df943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.324213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bdb53-8e41-4b3b-bdbd-2b29851df943 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.329531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a29c9-3094-4169-8d9d-7ffd3df46500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.331691 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a29c9-3094-4169-8d9d-7ffd3df46500 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.335994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 921/1854] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:25.336829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bdb53-8e41-4b3b-bdbd-2b29851df943 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.345257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 934/1855] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:25.346865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a29c9-3094-4169-8d9d-7ffd3df46500 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.378114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:25.441836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bdb53-8e41-4b3b-bdbd-2b29851df943 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.449850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a29c9-3094-4169-8d9d-7ffd3df46500 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.451468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.452390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.452676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.453037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.453726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.454827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466229b-1333-43ca-8c4d-94401f32dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.455456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466229b-1333-43ca-8c4d-94401f32dd50 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.455880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466229b-1333-43ca-8c4d-94401f32dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.456158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466229b-1333-43ca-8c4d-94401f32dd50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.456796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466229b-1333-43ca-8c4d-94401f32dd50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.457867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.458935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466229b-1333-43ca-8c4d-94401f32dd50 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.508094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 922/1856] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:25 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:25.509156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.514719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:25.525811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 935/1857] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:25 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:25.526878 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466229b-1333-43ca-8c4d-94401f32dd50 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.537985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:25.556891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23d66-cf42-4ca6-8f89-a35ca8f64648 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.659354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466229b-1333-43ca-8c4d-94401f32dd50 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.661258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.661935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.662213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.662493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] PATH_INFO: `/v3/users/8254f9f1524c492d86b42f8e7efb51a3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.665549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8254f9f1524c492d86b42f8e7efb51a3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.666758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d6c5-bd09-4e67-8af7-ff25b4f0f67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.668003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.669121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d6c5-bd09-4e67-8af7-ff25b4f0f67b admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.669445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d6c5-bd09-4e67-8af7-ff25b4f0f67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.669790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989d6c5-bd09-4e67-8af7-ff25b4f0f67b admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.670407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989d6c5-bd09-4e67-8af7-ff25b4f0f67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.672201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989d6c5-bd09-4e67-8af7-ff25b4f0f67b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.689683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 936/1858] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:25.690630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d6c5-bd09-4e67-8af7-ff25b4f0f67b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.703616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989d6c5-bd09-4e67-8af7-ff25b4f0f67b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.711161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c992c65-e2ff-4af0-8f00-31e367ec3774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.711892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c992c65-e2ff-4af0-8f00-31e367ec3774 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.712180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c992c65-e2ff-4af0-8f00-31e367ec3774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.712457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c992c65-e2ff-4af0-8f00-31e367ec3774 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.713173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c992c65-e2ff-4af0-8f00-31e367ec3774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.715195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c992c65-e2ff-4af0-8f00-31e367ec3774 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.753247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 937/1859] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:25 2022] POST /identity/v3/users => generated 296 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:25.754258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c992c65-e2ff-4af0-8f00-31e367ec3774 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.767438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c992c65-e2ff-4af0-8f00-31e367ec3774 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:25.767826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8254f9f1524c492d86b42f8e7efb51a3'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.774855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:25.776981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:25.777578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:25.778059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] PATH_INFO: `/v3/users/16b6b10d0ea640bcbad1fb7bc9efd94d` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:25.779551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b6b10d0ea640bcbad1fb7bc9efd94d)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:25.781784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:25.785578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8254f9f1524c492d86b42f8e7efb51a3'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.796675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8254f9f1524c492d86b42f8e7efb51a3'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.811884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8254f9f1524c492d86b42f8e7efb51a3'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.812989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8254f9f1524c492d86b42f8e7efb51a3'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.825060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 923/1860] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:25 2022] DELETE /identity/v3/users/8254f9f1524c492d86b42f8e7efb51a3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:25.826488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.828728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:25.863300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b6b10d0ea640bcbad1fb7bc9efd94d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.863707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b6b10d0ea640bcbad1fb7bc9efd94d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.885684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b6b10d0ea640bcbad1fb7bc9efd94d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.906993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b6b10d0ea640bcbad1fb7bc9efd94d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.907432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:25.923327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b6b10d0ea640bcbad1fb7bc9efd94d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:25.936003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 938/1861] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:25 2022] DELETE /identity/v3/users/16b6b10d0ea640bcbad1fb7bc9efd94d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:25.936003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:25.936293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:25.953556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d012c2-5310-4c48-8e59-3fd4d6dd40c1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.075225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:26.089292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610aab41-eade-4295-94de-b73d91d218e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.090915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aab41-eade-4295-94de-b73d91d218e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.091445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aab41-eade-4295-94de-b73d91d218e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.092277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aab41-eade-4295-94de-b73d91d218e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.093221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32b0ef-c4c9-4d1e-8d3f-2c981965c726 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.093572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aab41-eade-4295-94de-b73d91d218e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.095828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610aab41-eade-4295-94de-b73d91d218e1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.099073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b284c-cab9-4fdf-ad95-14f4a5635cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.099705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b284c-cab9-4fdf-ad95-14f4a5635cdf admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.099988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b284c-cab9-4fdf-ad95-14f4a5635cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.100262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b284c-cab9-4fdf-ad95-14f4a5635cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.101009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b284c-cab9-4fdf-ad95-14f4a5635cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.102968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b284c-cab9-4fdf-ad95-14f4a5635cdf admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.111312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 924/1862] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:26.114269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7c8c-5fc1-48ca-bc08-88a2e03c670f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.114779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7c8c-5fc1-48ca-bc08-88a2e03c670f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.115281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7c8c-5fc1-48ca-bc08-88a2e03c670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.124430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 939/1863] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:26.125932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df954b-ddfa-4ff4-acfc-ac5636efbab8 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.126279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df954b-ddfa-4ff4-acfc-ac5636efbab8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.126531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df954b-ddfa-4ff4-acfc-ac5636efbab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.143220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d3af7c8c-5fc1-48ca-bc08-88a2e03c670f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:26.144847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d3af7c8c-5fc1-48ca-bc08-88a2e03c670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:26.147460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-85df954b-ddfa-4ff4-acfc-ac5636efbab8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:26.148674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-85df954b-ddfa-4ff4-acfc-ac5636efbab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:26.155039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 925/1864] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:26.155508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af7c8c-5fc1-48ca-bc08-88a2e03c670f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.156758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d3af7c8c-5fc1-48ca-bc08-88a2e03c670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:26.161002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 940/1865] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:26.161002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df954b-ddfa-4ff4-acfc-ac5636efbab8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.170674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df954b-ddfa-4ff4-acfc-ac5636efbab8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.170980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af7c8c-5fc1-48ca-bc08-88a2e03c670f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.175937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40bb65-6acd-4ab2-957c-493e0252e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.176624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40bb65-6acd-4ab2-957c-493e0252e94e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.176902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40bb65-6acd-4ab2-957c-493e0252e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.177177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.177428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40bb65-6acd-4ab2-957c-493e0252e94e admin admin] PATH_INFO: `/v3/projects/9b1e5dcf25a945469affc0b3dc92eb00/users/526fa40452964693b5255f1f287397bb/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.178113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.178507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.178935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.179827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.181733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.196226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40bb65-6acd-4ab2-957c-493e0252e94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1e5dcf25a945469affc0b3dc92eb00, user_id=526fa40452964693b5255f1f287397bb, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.199645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 941/1866] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:26.199750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40bb65-6acd-4ab2-957c-493e0252e94e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.200098 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.201842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:26.244881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 926/1867] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:26 2022] PUT /identity/v3/projects/9b1e5dcf25a945469affc0b3dc92eb00/users/526fa40452964693b5255f1f287397bb/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:26.244881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40bb65-6acd-4ab2-957c-493e0252e94e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.271187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf90694-8862-4c1d-8720-966c57edbcc0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.318353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40bb65-6acd-4ab2-957c-493e0252e94e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.323318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040b2e1-032b-4a93-bcd4-61f756a6294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.323978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040b2e1-032b-4a93-bcd4-61f756a6294f admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.324253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040b2e1-032b-4a93-bcd4-61f756a6294f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.324521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040b2e1-032b-4a93-bcd4-61f756a6294f admin admin] PATH_INFO: `/v3/projects/f9a1fa7ec93f4529ba1a1fa56a4cda91/users/2c29e2f0617f4e0c918bdf5a73453f23/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.327216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2964a3-96c3-47b6-9443-4806bae2f95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.328338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2964a3-96c3-47b6-9443-4806bae2f95e service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.328338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2964a3-96c3-47b6-9443-4806bae2f95e service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.328594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2964a3-96c3-47b6-9443-4806bae2f95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.341481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2964a3-96c3-47b6-9443-4806bae2f95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.341789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040b2e1-032b-4a93-bcd4-61f756a6294f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a1fa7ec93f4529ba1a1fa56a4cda91, user_id=2c29e2f0617f4e0c918bdf5a73453f23, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.343396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2964a3-96c3-47b6-9443-4806bae2f95e service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.344410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040b2e1-032b-4a93-bcd4-61f756a6294f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.358803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 942/1868] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:26.361752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2964a3-96c3-47b6-9443-4806bae2f95e service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.372636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 927/1869] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:26 2022] PUT /identity/v3/projects/f9a1fa7ec93f4529ba1a1fa56a4cda91/users/2c29e2f0617f4e0c918bdf5a73453f23/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:26.372966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2964a3-96c3-47b6-9443-4806bae2f95e service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.374372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a59907-b377-478b-858e-9671000c93b9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.374659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a59907-b377-478b-858e-9671000c93b9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.374933 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a59907-b377-478b-858e-9671000c93b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.407138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e1a59907-b377-478b-858e-9671000c93b9 None None] MFA Rules not processed for user `526fa40452964693b5255f1f287397bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:26.408471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e1a59907-b377-478b-858e-9671000c93b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:26.439708 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:26.448408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330ea3-c892-43ac-a41b-7a7c4694f11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.449903 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330ea3-c892-43ac-a41b-7a7c4694f11e service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.450666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330ea3-c892-43ac-a41b-7a7c4694f11e service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.451104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330ea3-c892-43ac-a41b-7a7c4694f11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.496844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 928/1870] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:26.502839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04ea2-4f00-4b4d-96ce-73fbbca94aee None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.505602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04ea2-4f00-4b4d-96ce-73fbbca94aee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.506114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04ea2-4f00-4b4d-96ce-73fbbca94aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.539239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:26.553894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2fc04ea2-4f00-4b4d-96ce-73fbbca94aee None None] MFA Rules not processed for user `2c29e2f0617f4e0c918bdf5a73453f23`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:26.556321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2fc04ea2-4f00-4b4d-96ce-73fbbca94aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:26.575807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330ea3-c892-43ac-a41b-7a7c4694f11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.578375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330ea3-c892-43ac-a41b-7a7c4694f11e service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.594428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 943/1871] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:26.597250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330ea3-c892-43ac-a41b-7a7c4694f11e service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.629470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330ea3-c892-43ac-a41b-7a7c4694f11e service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.637132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a35e4b-3b49-4b4c-8088-0c0ccd2ebb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.638139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35e4b-3b49-4b4c-8088-0c0ccd2ebb36 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.639022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35e4b-3b49-4b4c-8088-0c0ccd2ebb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.639304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35e4b-3b49-4b4c-8088-0c0ccd2ebb36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.640136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35e4b-3b49-4b4c-8088-0c0ccd2ebb36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.642692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35e4b-3b49-4b4c-8088-0c0ccd2ebb36 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.666685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 929/1872] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:26.671596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04ea2-4f00-4b4d-96ce-73fbbca94aee None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.686354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 944/1873] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:26 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:26.686952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04ea2-4f00-4b4d-96ce-73fbbca94aee None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.691973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a35e4b-3b49-4b4c-8088-0c0ccd2ebb36 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.787242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14e1c-01ec-46f3-96dd-115e0d62c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.790400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14e1c-01ec-46f3-96dd-115e0d62c29f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.790400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14e1c-01ec-46f3-96dd-115e0d62c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.793709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14e1c-01ec-46f3-96dd-115e0d62c29f admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.795204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14e1c-01ec-46f3-96dd-115e0d62c29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.798017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14e1c-01ec-46f3-96dd-115e0d62c29f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.829427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a35e4b-3b49-4b4c-8088-0c0ccd2ebb36 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.835695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff85d49-2ba8-4ab4-be70-c54435fd41b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.836567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff85d49-2ba8-4ab4-be70-c54435fd41b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.836915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff85d49-2ba8-4ab4-be70-c54435fd41b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.837225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff85d49-2ba8-4ab4-be70-c54435fd41b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.837938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff85d49-2ba8-4ab4-be70-c54435fd41b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.839867 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff85d49-2ba8-4ab4-be70-c54435fd41b9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.853734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 930/1874] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:26 2022] POST /identity/v3/projects => generated 393 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:26.855361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14e1c-01ec-46f3-96dd-115e0d62c29f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.904701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 945/1875] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:26 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:26.909912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff85d49-2ba8-4ab4-be70-c54435fd41b9 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:26.920922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:26.950955 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14e1c-01ec-46f3-96dd-115e0d62c29f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.956896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc693ce-d8bb-4419-a76f-9011a93ee909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.957730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc693ce-d8bb-4419-a76f-9011a93ee909 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.958015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc693ce-d8bb-4419-a76f-9011a93ee909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.958349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc693ce-d8bb-4419-a76f-9011a93ee909 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.959000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc693ce-d8bb-4419-a76f-9011a93ee909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.961080 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc693ce-d8bb-4419-a76f-9011a93ee909 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:26.961428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff85d49-2ba8-4ab4-be70-c54435fd41b9 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:26.973620 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a06b-3987-48ba-9300-1e55e869c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:26.976205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a06b-3987-48ba-9300-1e55e869c680 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:26.976536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a06b-3987-48ba-9300-1e55e869c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:26.976813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5a06b-3987-48ba-9300-1e55e869c680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:26.978807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5a06b-3987-48ba-9300-1e55e869c680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:26.983207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5a06b-3987-48ba-9300-1e55e869c680 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.008987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 946/1876] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:27.010434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a06b-3987-48ba-9300-1e55e869c680 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.013014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 931/1877] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:26 2022] POST /identity/v3/users => generated 303 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:27.014525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc693ce-d8bb-4419-a76f-9011a93ee909 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.040187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc693ce-d8bb-4419-a76f-9011a93ee909 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.042421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5a06b-3987-48ba-9300-1e55e869c680 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.048512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.049706 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.049988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.050631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.052121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.053880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.056289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde402-68c0-443f-a669-151962036205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.057116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde402-68c0-443f-a669-151962036205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.057402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde402-68c0-443f-a669-151962036205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.057666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde402-68c0-443f-a669-151962036205 admin admin] PATH_INFO: `/v3/projects/bacdf06d08aa45ca8ae08ac7ce543b8a/users/a3905c0563a24c43818834791b6f0e86/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.070258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 932/1878] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:27.071267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.075375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:27.091228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bde402-68c0-443f-a669-151962036205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacdf06d08aa45ca8ae08ac7ce543b8a, user_id=a3905c0563a24c43818834791b6f0e86, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.093915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31896216-0f84-4735-b65f-d1ad1fbaf9d5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.094373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bde402-68c0-443f-a669-151962036205 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.100101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.102042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.102544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.103005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] PATH_INFO: `/v3/projects/0c4ff15232fe4e14bb2b728c1966ad8d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.117022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4ff15232fe4e14bb2b728c1966ad8d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.120984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.122037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 947/1879] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:27 2022] PUT /identity/v3/projects/bacdf06d08aa45ca8ae08ac7ce543b8a/users/a3905c0563a24c43818834791b6f0e86/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:27.123112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde402-68c0-443f-a669-151962036205 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.225318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4ff15232fe4e14bb2b728c1966ad8d', 'request_id': 'req-251d1725-92b3-40cf-8539-3128a83c5bb7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.241311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4ff15232fe4e14bb2b728c1966ad8d', 'request_id': 'req-251d1725-92b3-40cf-8539-3128a83c5bb7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.282486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4ff15232fe4e14bb2b728c1966ad8d', 'request_id': 'req-251d1725-92b3-40cf-8539-3128a83c5bb7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.293666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde402-68c0-443f-a669-151962036205 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.296021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] The token cache is being invalidate because project 0c4ff15232fe4e14bb2b728c1966ad8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:27.296318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.297001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.301928 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 933/1880] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:27 2022] DELETE /identity/v3/projects/0c4ff15232fe4e14bb2b728c1966ad8d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:27.301928 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.302734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:27.336139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:27.419146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d1725-92b3-40cf-8539-3128a83c5bb7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.425141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.426354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.426636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.427058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.427780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.430054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.440999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.441724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.442002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.442274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] PATH_INFO: `/v3/projects/91767f3ef87748c0a23a560772b424ca/users/5e9f40fc125b489a85efc410b5916c5e/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.446341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 934/1881] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:27.446341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.448857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:27.470491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfd53b-25f0-41c3-bdb6-e30b3f70515c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.475129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91767f3ef87748c0a23a560772b424ca, user_id=5e9f40fc125b489a85efc410b5916c5e, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.478535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.484845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.485513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.485971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.485971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] PATH_INFO: `/v3/projects/cebdcbb6c4284e499896dcd033453d99` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.488097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebdcbb6c4284e499896dcd033453d99)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.489261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.514049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 948/1882] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:27 2022] PUT /identity/v3/projects/91767f3ef87748c0a23a560772b424ca/users/5e9f40fc125b489a85efc410b5916c5e/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:27.516470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.518662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:27.571602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:27.598723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebdcbb6c4284e499896dcd033453d99', 'request_id': 'req-2032e601-d967-4c97-90bc-c9bdee066097'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.615811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebdcbb6c4284e499896dcd033453d99', 'request_id': 'req-2032e601-d967-4c97-90bc-c9bdee066097'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.630085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebdcbb6c4284e499896dcd033453d99', 'request_id': 'req-2032e601-d967-4c97-90bc-c9bdee066097'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.647277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163eb6-dff0-4a6b-8394-df334224bb22 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.648868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] The token cache is being invalidate because project cebdcbb6c4284e499896dcd033453d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:27.649285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.650920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.652692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 935/1883] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:27 2022] DELETE /identity/v3/projects/cebdcbb6c4284e499896dcd033453d99 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:27.653511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.654929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:27.745534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.746420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.746702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.747029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] PATH_INFO: `/v3/users/7063c746ab8a4ec6b9eab60ad2ece156` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.749212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7063c746ab8a4ec6b9eab60ad2ece156)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.752794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.754172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032e601-d967-4c97-90bc-c9bdee066097 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.760721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.763127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.765347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.765778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] PATH_INFO: `/v3/projects/bacdf06d08aa45ca8ae08ac7ce543b8a/users/a3905c0563a24c43818834791b6f0e86/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.768077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacdf06d08aa45ca8ae08ac7ce543b8a, user_id=a3905c0563a24c43818834791b6f0e86, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.771581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.786419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 936/1884] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:27 2022] PUT /identity/v3/projects/bacdf06d08aa45ca8ae08ac7ce543b8a/users/a3905c0563a24c43818834791b6f0e86/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:27.787385 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:27.800906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:27.853374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7063c746ab8a4ec6b9eab60ad2ece156'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.854452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7063c746ab8a4ec6b9eab60ad2ece156'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.864321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:27.878528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7063c746ab8a4ec6b9eab60ad2ece156'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.889469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe2a4f-0b7b-4c32-92a1-96d253e13665 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:27.895253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a2af3-dfa6-43d8-96ae-94b82bb03cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:27.895714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7063c746ab8a4ec6b9eab60ad2ece156'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.895881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2af3-dfa6-43d8-96ae-94b82bb03cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.896288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2af3-dfa6-43d8-96ae-94b82bb03cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.897775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2af3-dfa6-43d8-96ae-94b82bb03cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.897775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a2af3-dfa6-43d8-96ae-94b82bb03cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:27.899814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a2af3-dfa6-43d8-96ae-94b82bb03cd7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:27.912622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4be03e77-dc73-4868-a03d-571b54adcd39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7063c746ab8a4ec6b9eab60ad2ece156'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:27.915387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 937/1885] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:27.917032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c521c6e-a4c4-4aac-bb02-98aefa7a5c1f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.917753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c521c6e-a4c4-4aac-bb02-98aefa7a5c1f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.917863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c521c6e-a4c4-4aac-bb02-98aefa7a5c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.924257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 949/1886] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:27 2022] DELETE /identity/v3/users/7063c746ab8a4ec6b9eab60ad2ece156 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:27.926110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283035d-2456-44f3-b672-bf92222b8dd3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:27.926575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283035d-2456-44f3-b672-bf92222b8dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:27.927029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283035d-2456-44f3-b672-bf92222b8dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:27.971488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-2283035d-2456-44f3-b672-bf92222b8dd3 None None] MFA Rules not processed for user `a3905c0563a24c43818834791b6f0e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:27.973395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2283035d-2456-44f3-b672-bf92222b8dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:27.973516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4c521c6e-a4c4-4aac-bb02-98aefa7a5c1f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:27.974624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4c521c6e-a4c4-4aac-bb02-98aefa7a5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:28.052499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:28.074609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 950/1887] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:28.075874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283035d-2456-44f3-b672-bf92222b8dd3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.079780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2283035d-2456-44f3-b672-bf92222b8dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:28.097758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 938/1888] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:28.097758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c521c6e-a4c4-4aac-bb02-98aefa7a5c1f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.101130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4c521c6e-a4c4-4aac-bb02-98aefa7a5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:28.109414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283035d-2456-44f3-b672-bf92222b8dd3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.119899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43304f38-bd16-4869-88dd-63d7198e14e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.121377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43304f38-bd16-4869-88dd-63d7198e14e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.121822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43304f38-bd16-4869-88dd-63d7198e14e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.122540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43304f38-bd16-4869-88dd-63d7198e14e8 admin admin] PATH_INFO: `/v3/projects/91767f3ef87748c0a23a560772b424ca/users/5e9f40fc125b489a85efc410b5916c5e/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.124579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43304f38-bd16-4869-88dd-63d7198e14e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91767f3ef87748c0a23a560772b424ca, user_id=5e9f40fc125b489a85efc410b5916c5e, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.127744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43304f38-bd16-4869-88dd-63d7198e14e8 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.141497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 951/1889] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:28 2022] PUT /identity/v3/projects/91767f3ef87748c0a23a560772b424ca/users/5e9f40fc125b489a85efc410b5916c5e/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:28.143369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3fd65-1be9-4f40-a2fb-da69955868a7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.143704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3fd65-1be9-4f40-a2fb-da69955868a7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.143977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3fd65-1be9-4f40-a2fb-da69955868a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.170932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f9f3fd65-1be9-4f40-a2fb-da69955868a7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:28.172443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f9f3fd65-1be9-4f40-a2fb-da69955868a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:28.192031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c521c6e-a4c4-4aac-bb02-98aefa7a5c1f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.289612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f7a5-2d3b-4ffb-bc01-f2b0178781c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.290927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f7a5-2d3b-4ffb-bc01-f2b0178781c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.291467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f7a5-2d3b-4ffb-bc01-f2b0178781c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.291919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f7a5-2d3b-4ffb-bc01-f2b0178781c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.293132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 952/1890] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:28.294434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b047-e741-4f02-ad06-afe3465069fa None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.294721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b047-e741-4f02-ad06-afe3465069fa None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.295747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b047-e741-4f02-ad06-afe3465069fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.348547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d694b047-e741-4f02-ad06-afe3465069fa None None] MFA Rules not processed for user `5e9f40fc125b489a85efc410b5916c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:28.350450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d694b047-e741-4f02-ad06-afe3465069fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:28.387353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:28.397918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650f7a5-2d3b-4ffb-bc01-f2b0178781c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.399398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650f7a5-2d3b-4ffb-bc01-f2b0178781c9 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.411232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 939/1891] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:28.412181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f7a5-2d3b-4ffb-bc01-f2b0178781c9 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.423577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f7a5-2d3b-4ffb-bc01-f2b0178781c9 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.428305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.429334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.429617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.429889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.430830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:28.430830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.432476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.446879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 940/1892] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:28.451011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.451461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 953/1893] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:28.462919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe108b2b-cf7e-41d3-aec8-10aca282ab39 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.466344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694b047-e741-4f02-ad06-afe3465069fa None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.469655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d694b047-e741-4f02-ad06-afe3465069fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:28.472041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3b794-0efe-462b-b244-b54d461e7a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.472830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b794-0efe-462b-b244-b54d461e7a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.473142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b794-0efe-462b-b244-b54d461e7a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.473442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b794-0efe-462b-b244-b54d461e7a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.474286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3b794-0efe-462b-b244-b54d461e7a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.476195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3b794-0efe-462b-b244-b54d461e7a42 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.487534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694b047-e741-4f02-ad06-afe3465069fa None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.512419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453642e6-7897-4ffb-acfa-10729715dc65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.513306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453642e6-7897-4ffb-acfa-10729715dc65 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.513544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453642e6-7897-4ffb-acfa-10729715dc65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.514254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453642e6-7897-4ffb-acfa-10729715dc65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.540423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 941/1894] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:28 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:28.540423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3b794-0efe-462b-b244-b54d461e7a42 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.540687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453642e6-7897-4ffb-acfa-10729715dc65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.543378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453642e6-7897-4ffb-acfa-10729715dc65 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.558993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 954/1895] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:28.559981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453642e6-7897-4ffb-acfa-10729715dc65 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.573819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453642e6-7897-4ffb-acfa-10729715dc65 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.583066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:28.635616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3b794-0efe-462b-b244-b54d461e7a42 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.646244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.654638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.654926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.655207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.657853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:28.696205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c343c-7312-4067-b545-3ce064a02f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.697295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c343c-7312-4067-b545-3ce064a02f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.697824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c343c-7312-4067-b545-3ce064a02f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.698635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c343c-7312-4067-b545-3ce064a02f5a admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.699634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c343c-7312-4067-b545-3ce064a02f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.702117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c343c-7312-4067-b545-3ce064a02f5a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.743364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.745367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.755797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 955/1896] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:28 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:28.757222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c343c-7312-4067-b545-3ce064a02f5a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.763684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 942/1897] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:28.765346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.786182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb4243-da3e-4147-8bf9-4a95f28e1d7f service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.795410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa47b8f-2de7-4708-bbed-f6babd8a04d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.796306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa47b8f-2de7-4708-bbed-f6babd8a04d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.797829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa47b8f-2de7-4708-bbed-f6babd8a04d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.798331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa47b8f-2de7-4708-bbed-f6babd8a04d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.808633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c343c-7312-4067-b545-3ce064a02f5a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.812723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6f0fc-eca1-4178-872a-00aad906f24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.813491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f0fc-eca1-4178-872a-00aad906f24d service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.813793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f0fc-eca1-4178-872a-00aad906f24d service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.814830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f0fc-eca1-4178-872a-00aad906f24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.817253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa47b8f-2de7-4708-bbed-f6babd8a04d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.817343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7cf6f0fc-eca1-4178-872a-00aad906f24d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:28.823478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa47b8f-2de7-4708-bbed-f6babd8a04d5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.839295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 943/1898] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:28.842870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa47b8f-2de7-4708-bbed-f6babd8a04d5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.858388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa47b8f-2de7-4708-bbed-f6babd8a04d5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.863966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b0bf6-3a09-4eb8-ae42-5b6332d5e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.865154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b0bf6-3a09-4eb8-ae42-5b6332d5e0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.865828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b0bf6-3a09-4eb8-ae42-5b6332d5e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.866371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b0bf6-3a09-4eb8-ae42-5b6332d5e0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.867600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b0bf6-3a09-4eb8-ae42-5b6332d5e0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.869873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b0bf6-3a09-4eb8-ae42-5b6332d5e0d2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.883099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 944/1899] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:28.887204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b0bf6-3a09-4eb8-ae42-5b6332d5e0d2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:28.907281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b0bf6-3a09-4eb8-ae42-5b6332d5e0d2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:28.918410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:28.920287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:28.921585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:28.922090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] PATH_INFO: `/v3/projects/8f11ed465b2347dc863ff978ae80a95c/users/0054f5386b2a405a9b4565db2559d856/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:28.948025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f11ed465b2347dc863ff978ae80a95c, user_id=0054f5386b2a405a9b4565db2559d856, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.955750 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6f0fc-eca1-4178-872a-00aad906f24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:28.957245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6f0fc-eca1-4178-872a-00aad906f24d service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.957536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:28.969149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 956/1900] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:29.004782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 945/1901] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:28 2022] PUT /identity/v3/projects/8f11ed465b2347dc863ff978ae80a95c/users/0054f5386b2a405a9b4565db2559d856/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:29.018553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95e0e-9da4-4c1d-a776-f55884d3212b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.019046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95e0e-9da4-4c1d-a776-f55884d3212b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.019343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b95e0e-9da4-4c1d-a776-f55884d3212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.111015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-09b95e0e-9da4-4c1d-a776-f55884d3212b None None] MFA Rules not processed for user `0054f5386b2a405a9b4565db2559d856`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:29.114512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-09b95e0e-9da4-4c1d-a776-f55884d3212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:29.185494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:29.208884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:29.211065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:29.257683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 957/1902] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:29.272727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95e0e-9da4-4c1d-a776-f55884d3212b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:29.378875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfeea9-fd3a-4947-a2c8-823e5eb785b3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:29.400984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:29.400984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.400984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.400984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] PATH_INFO: `/v3/projects/702faa01bc4344c1bf9d880f1e7d5489` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.401588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702faa01bc4344c1bf9d880f1e7d5489)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:29.406936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:29.445147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b95e0e-9da4-4c1d-a776-f55884d3212b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:29.455477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689c8a7-e858-4604-b4f2-682d5a3a4c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:29.456237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c8a7-e858-4604-b4f2-682d5a3a4c52 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.456645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c8a7-e858-4604-b4f2-682d5a3a4c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.457287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689c8a7-e858-4604-b4f2-682d5a3a4c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.487145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689c8a7-e858-4604-b4f2-682d5a3a4c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:29.488747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689c8a7-e858-4604-b4f2-682d5a3a4c52 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:29.494551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:29.509238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702faa01bc4344c1bf9d880f1e7d5489', 'request_id': 'req-31c4f303-668d-4778-bad7-688323a2ddc1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.512694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 958/1903] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:29.516345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1bb11-e83d-4693-b2e8-f21b1d92cae5 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.516673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1bb11-e83d-4693-b2e8-f21b1d92cae5 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.517263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1bb11-e83d-4693-b2e8-f21b1d92cae5 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.519084 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 959/1904] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:19:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:19:29.521645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702faa01bc4344c1bf9d880f1e7d5489', 'request_id': 'req-31c4f303-668d-4778-bad7-688323a2ddc1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.531745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702faa01bc4344c1bf9d880f1e7d5489', 'request_id': 'req-31c4f303-668d-4778-bad7-688323a2ddc1'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.538412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1bb11-e83d-4693-b2e8-f21b1d92cae5 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:29.550549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] The token cache is being invalidate because project 702faa01bc4344c1bf9d880f1e7d5489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:29.550882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.551454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-31c4f303-668d-4778-bad7-688323a2ddc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.553677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 946/1905] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:29 2022] DELETE /identity/v3/projects/702faa01bc4344c1bf9d880f1e7d5489 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:29.561049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9121-e75f-40d2-b39f-73e054fb1818 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.562711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9121-e75f-40d2-b39f-73e054fb1818 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.563011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab9121-e75f-40d2-b39f-73e054fb1818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.617498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bdab9121-e75f-40d2-b39f-73e054fb1818 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:29.618932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bdab9121-e75f-40d2-b39f-73e054fb1818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:29.710298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1bb11-e83d-4693-b2e8-f21b1d92cae5 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:29.736126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:29.736872 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.737222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.737505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] PATH_INFO: `/v3/users/0054f5386b2a405a9b4565db2559d856` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.741920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0054f5386b2a405a9b4565db2559d856)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:29.743889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:29.794330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 947/1906] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:29.796075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac21a-87b1-407e-94e2-4776555dc093 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.796562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac21a-87b1-407e-94e2-4776555dc093 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.797058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac21a-87b1-407e-94e2-4776555dc093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.812207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0054f5386b2a405a9b4565db2559d856'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.812973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0054f5386b2a405a9b4565db2559d856'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.826749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c59ac21a-87b1-407e-94e2-4776555dc093 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:29.828181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c59ac21a-87b1-407e-94e2-4776555dc093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:29.833672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0054f5386b2a405a9b4565db2559d856'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.848015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0054f5386b2a405a9b4565db2559d856'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.850705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:29.860165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0fbb5171-ce31-4520-9145-9dbb39fdc4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0054f5386b2a405a9b4565db2559d856'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:29.870863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 960/1907] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:29 2022] DELETE /identity/v3/users/0054f5386b2a405a9b4565db2559d856 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:29.872255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a88c-fef5-4eb5-938d-904d2b686bbf None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.872538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a88c-fef5-4eb5-938d-904d2b686bbf None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.872811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57a88c-fef5-4eb5-938d-904d2b686bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.910541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4e57a88c-fef5-4eb5-938d-904d2b686bbf None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:29.913573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4e57a88c-fef5-4eb5-938d-904d2b686bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:29.935207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 948/1908] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:19:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:29.936741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0fda-6713-4e2e-9353-a2f628837d8f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:29.937030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0fda-6713-4e2e-9353-a2f628837d8f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:29.940691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0fda-6713-4e2e-9353-a2f628837d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:29.985996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1d5e0fda-6713-4e2e-9353-a2f628837d8f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:29.987302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1d5e0fda-6713-4e2e-9353-a2f628837d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:30.055790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 961/1909] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:30.060091 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a88c-fef5-4eb5-938d-904d2b686bbf None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:30.075247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57a88c-fef5-4eb5-938d-904d2b686bbf None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:30.081253 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:30.081998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.082376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.082749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.083582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:30.083979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:30.087237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:30.089200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:30.103892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 962/1910] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:19:30.111086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:30.116727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 949/1911] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:30.130189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e0fda-6713-4e2e-9353-a2f628837d8f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:30.130838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773126c-40ba-419f-844d-b9786a452cde admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:30.131652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1d5e0fda-6713-4e2e-9353-a2f628837d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:30.141830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:30.143201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.144157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.145162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.146456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:30.149580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:30.205229 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 963/1912] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:30 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:30.205229 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:30.206953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:30.242345 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e0fda-6713-4e2e-9353-a2f628837d8f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:30.302420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a6e47-c5ab-498c-9759-0872187d2e66 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:30.308381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396037b1-c1b9-4fac-b7de-bd5ef6c7e2ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:30.309037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396037b1-c1b9-4fac-b7de-bd5ef6c7e2ce service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.309356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396037b1-c1b9-4fac-b7de-bd5ef6c7e2ce service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.309636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396037b1-c1b9-4fac-b7de-bd5ef6c7e2ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.319919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396037b1-c1b9-4fac-b7de-bd5ef6c7e2ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:30.323265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396037b1-c1b9-4fac-b7de-bd5ef6c7e2ce service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:30.326112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee5ed-451a-4657-bdd5-a5a4bbe24210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:30.326752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee5ed-451a-4657-bdd5-a5a4bbe24210 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.327033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee5ed-451a-4657-bdd5-a5a4bbe24210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.327392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee5ed-451a-4657-bdd5-a5a4bbe24210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.345308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 964/1913] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:30.345982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396037b1-c1b9-4fac-b7de-bd5ef6c7e2ce service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:30.426958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cee5ed-451a-4657-bdd5-a5a4bbe24210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:30.428932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cee5ed-451a-4657-bdd5-a5a4bbe24210 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:30.441915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 950/1914] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:30.480573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:30.539736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396037b1-c1b9-4fac-b7de-bd5ef6c7e2ce service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:30.545778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d438-b4d1-4600-9c4d-6837e81d869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:30.546465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d438-b4d1-4600-9c4d-6837e81d869e admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.546739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d438-b4d1-4600-9c4d-6837e81d869e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.547054 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33d438-b4d1-4600-9c4d-6837e81d869e admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.547820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d438-b4d1-4600-9c4d-6837e81d869e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:30.551002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33d438-b4d1-4600-9c4d-6837e81d869e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:30.603215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 965/1915] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:30 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:30.606234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee5ed-451a-4657-bdd5-a5a4bbe24210 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:30.619452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee5ed-451a-4657-bdd5-a5a4bbe24210 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:30.633368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10258b-3b4c-4ec5-8261-bd007a5470f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:30.634125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10258b-3b4c-4ec5-8261-bd007a5470f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.634312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10258b-3b4c-4ec5-8261-bd007a5470f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.634583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10258b-3b4c-4ec5-8261-bd007a5470f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.635273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10258b-3b4c-4ec5-8261-bd007a5470f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:30.636926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10258b-3b4c-4ec5-8261-bd007a5470f0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:30.668398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 951/1916] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:30.672254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d438-b4d1-4600-9c4d-6837e81d869e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:30.686376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33d438-b4d1-4600-9c4d-6837e81d869e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:30.694117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c77a46-c853-4c9c-b5e8-a129d23c61f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:30.694993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77a46-c853-4c9c-b5e8-a129d23c61f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.696103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77a46-c853-4c9c-b5e8-a129d23c61f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.696103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c77a46-c853-4c9c-b5e8-a129d23c61f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.696511 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c77a46-c853-4c9c-b5e8-a129d23c61f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:30.698396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c77a46-c853-4c9c-b5e8-a129d23c61f0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:30.715228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 966/1917] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:30.716591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10258b-3b4c-4ec5-8261-bd007a5470f0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:30.731286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10258b-3b4c-4ec5-8261-bd007a5470f0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:30.740675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ade87-c1f6-473e-ab2b-5c033c00888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:30.741736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ade87-c1f6-473e-ab2b-5c033c00888a admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.741908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ade87-c1f6-473e-ab2b-5c033c00888a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.742497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ade87-c1f6-473e-ab2b-5c033c00888a admin admin] PATH_INFO: `/v3/projects/564dcfd905724f6c88cd01a38242c145/users/09247dc0133b4b46a55e20afb8f53813/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.764727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ade87-c1f6-473e-ab2b-5c033c00888a admin admin] RBAC: Authorizing `identity:create_grant(project_id=564dcfd905724f6c88cd01a38242c145, user_id=09247dc0133b4b46a55e20afb8f53813, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:30.769290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ade87-c1f6-473e-ab2b-5c033c00888a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:30.821830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 952/1918] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:30 2022] PUT /identity/v3/projects/564dcfd905724f6c88cd01a38242c145/users/09247dc0133b4b46a55e20afb8f53813/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:30.833737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd7f7-0f92-40d3-b4e0-b29a2ce9f82d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:30.834258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd7f7-0f92-40d3-b4e0-b29a2ce9f82d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:30.834627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfd7f7-0f92-40d3-b4e0-b29a2ce9f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:30.888170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-71cfd7f7-0f92-40d3-b4e0-b29a2ce9f82d None None] MFA Rules not processed for user `09247dc0133b4b46a55e20afb8f53813`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:30.891178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-71cfd7f7-0f92-40d3-b4e0-b29a2ce9f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:31.054711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 967/1919] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:31.059492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ade87-c1f6-473e-ab2b-5c033c00888a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.109995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:31.190461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ade87-c1f6-473e-ab2b-5c033c00888a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.196759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72402f84-d6ad-47af-a108-304cdccefe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.197788 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72402f84-d6ad-47af-a108-304cdccefe6c admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.198195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72402f84-d6ad-47af-a108-304cdccefe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.198571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72402f84-d6ad-47af-a108-304cdccefe6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.199674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72402f84-d6ad-47af-a108-304cdccefe6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.201835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72402f84-d6ad-47af-a108-304cdccefe6c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.256101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 953/1920] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:31 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:31.257300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfd7f7-0f92-40d3-b4e0-b29a2ce9f82d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.272755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfd7f7-0f92-40d3-b4e0-b29a2ce9f82d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.369845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.370618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.370897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.371160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.371977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.374608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.428530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 968/1921] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:31 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:31.432683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72402f84-d6ad-47af-a108-304cdccefe6c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.447246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72402f84-d6ad-47af-a108-304cdccefe6c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.472269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.474978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:31.481271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00fc66-a29a-46ac-b31b-9efb19ad0220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.484669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00fc66-a29a-46ac-b31b-9efb19ad0220 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.485255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00fc66-a29a-46ac-b31b-9efb19ad0220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.485751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00fc66-a29a-46ac-b31b-9efb19ad0220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.487338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00fc66-a29a-46ac-b31b-9efb19ad0220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.500274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00fc66-a29a-46ac-b31b-9efb19ad0220 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.509968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de74a54-fa64-4338-b59a-f387fc9d280b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.521910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 954/1922] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:31.523646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00fc66-a29a-46ac-b31b-9efb19ad0220 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.529513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.530184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.530467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.530747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] PATH_INFO: `/v3/projects/8f11ed465b2347dc863ff978ae80a95c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.532205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f11ed465b2347dc863ff978ae80a95c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.534862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.536770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00fc66-a29a-46ac-b31b-9efb19ad0220 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.543896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4502a9-4e78-471d-87e6-68a6eb00d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.545171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4502a9-4e78-471d-87e6-68a6eb00d3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.545818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4502a9-4e78-471d-87e6-68a6eb00d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.546278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4502a9-4e78-471d-87e6-68a6eb00d3f4 admin admin] PATH_INFO: `/v3/projects/1b9121f17c3b470ebfa8e348c76c8d7d/users/890ba021fa9e41f59f04662d5e864cc5/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.566238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4502a9-4e78-471d-87e6-68a6eb00d3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9121f17c3b470ebfa8e348c76c8d7d, user_id=890ba021fa9e41f59f04662d5e864cc5, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.569877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4502a9-4e78-471d-87e6-68a6eb00d3f4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.593053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:31.607453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 955/1923] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:31 2022] PUT /identity/v3/projects/1b9121f17c3b470ebfa8e348c76c8d7d/users/890ba021fa9e41f59f04662d5e864cc5/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:31.608468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f11ed465b2347dc863ff978ae80a95c', 'request_id': 'req-2f10a76e-df8c-4bda-9e34-774f672466c9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:31.611700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4502a9-4e78-471d-87e6-68a6eb00d3f4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.616974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f11ed465b2347dc863ff978ae80a95c', 'request_id': 'req-2f10a76e-df8c-4bda-9e34-774f672466c9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:31.630670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f11ed465b2347dc863ff978ae80a95c', 'request_id': 'req-2f10a76e-df8c-4bda-9e34-774f672466c9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:31.654570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] The token cache is being invalidate because project 8f11ed465b2347dc863ff978ae80a95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:31.654866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:31.656377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f10a76e-df8c-4bda-9e34-774f672466c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:31.661565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 969/1924] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:31 2022] DELETE /identity/v3/projects/8f11ed465b2347dc863ff978ae80a95c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:31.663646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800044-93d8-4466-8709-63182dbf7c32 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.664150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800044-93d8-4466-8709-63182dbf7c32 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.664622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76800044-93d8-4466-8709-63182dbf7c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.688094 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-76800044-93d8-4466-8709-63182dbf7c32 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:31.689334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-76800044-93d8-4466-8709-63182dbf7c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:31.719923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4502a9-4e78-471d-87e6-68a6eb00d3f4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.727605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.728367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.728721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.729074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.729892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.731617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.746874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 956/1925] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:31.751982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.758608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:31.775795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7df30-dae3-4b1d-a069-99028173b314 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.779446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 970/1926] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:31.787980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e706f0-5a29-4f48-93bd-ee1170a5a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.788799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e706f0-5a29-4f48-93bd-ee1170a5a87e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.789079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e706f0-5a29-4f48-93bd-ee1170a5a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.789385 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e706f0-5a29-4f48-93bd-ee1170a5a87e admin admin] PATH_INFO: `/v3/projects/1b9121f17c3b470ebfa8e348c76c8d7d/users/890ba021fa9e41f59f04662d5e864cc5/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.789936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b32c24-6a47-4442-b481-8ee0c73645e8 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.790402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b32c24-6a47-4442-b481-8ee0c73645e8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.790868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b32c24-6a47-4442-b481-8ee0c73645e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.791353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e706f0-5a29-4f48-93bd-ee1170a5a87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9121f17c3b470ebfa8e348c76c8d7d, user_id=890ba021fa9e41f59f04662d5e864cc5, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.794213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e706f0-5a29-4f48-93bd-ee1170a5a87e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.807210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 957/1927] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:31 2022] PUT /identity/v3/projects/1b9121f17c3b470ebfa8e348c76c8d7d/users/890ba021fa9e41f59f04662d5e864cc5/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:31.811935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-72b32c24-6a47-4442-b481-8ee0c73645e8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:31.813279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-72b32c24-6a47-4442-b481-8ee0c73645e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:31.818912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e46915-a36b-4463-9d44-f1e5eab8f589 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.819206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e46915-a36b-4463-9d44-f1e5eab8f589 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.820036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e46915-a36b-4463-9d44-f1e5eab8f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.852658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-97e46915-a36b-4463-9d44-f1e5eab8f589 None None] MFA Rules not processed for user `890ba021fa9e41f59f04662d5e864cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:31.853994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-97e46915-a36b-4463-9d44-f1e5eab8f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:31.883559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 971/1928] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:31.887853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b32c24-6a47-4442-b481-8ee0c73645e8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.898147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b32c24-6a47-4442-b481-8ee0c73645e8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.905753 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.906136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:31.907227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.907548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.907775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.908614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:31.908782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.912959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.930333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 972/1929] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:19:31.934056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.936314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 958/1930] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:31.945707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292b387-10f1-42b0-ad04-d7b75ff91432 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:31.948407 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e46915-a36b-4463-9d44-f1e5eab8f589 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:31.949908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-97e46915-a36b-4463-9d44-f1e5eab8f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:31.951362 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9a99f-35d9-46c1-9eaa-230727b3d0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:31.952045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9a99f-35d9-46c1-9eaa-230727b3d0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:31.952330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9a99f-35d9-46c1-9eaa-230727b3d0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:31.952600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9a99f-35d9-46c1-9eaa-230727b3d0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:31.953263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9a99f-35d9-46c1-9eaa-230727b3d0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:31.955559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9a99f-35d9-46c1-9eaa-230727b3d0aa admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:31.988100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 973/1931] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:31 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:31.993520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9a99f-35d9-46c1-9eaa-230727b3d0aa admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:32.019647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e46915-a36b-4463-9d44-f1e5eab8f589 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:32.035514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:32.066225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9a99f-35d9-46c1-9eaa-230727b3d0aa admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:32.071290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993c9f2-009d-4f7a-a847-7d3445373679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:32.071937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993c9f2-009d-4f7a-a847-7d3445373679 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.072353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993c9f2-009d-4f7a-a847-7d3445373679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.072723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993c9f2-009d-4f7a-a847-7d3445373679 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.073003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:32.073752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.074094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.074454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.075248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993c9f2-009d-4f7a-a847-7d3445373679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:32.076287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:32.077468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993c9f2-009d-4f7a-a847-7d3445373679 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:32.104324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 974/1932] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:31 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:32.108879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993c9f2-009d-4f7a-a847-7d3445373679 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:32.123897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993c9f2-009d-4f7a-a847-7d3445373679 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:32.131212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3714-eb0e-4c40-9f70-8d949be457c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:32.137291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3714-eb0e-4c40-9f70-8d949be457c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.137291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3714-eb0e-4c40-9f70-8d949be457c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.137291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f3714-eb0e-4c40-9f70-8d949be457c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.137291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f3714-eb0e-4c40-9f70-8d949be457c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:32.137291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f3714-eb0e-4c40-9f70-8d949be457c3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:32.148672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 975/1933] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:32.154032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3714-eb0e-4c40-9f70-8d949be457c3 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:32.175579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f3714-eb0e-4c40-9f70-8d949be457c3 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:32.183470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:32.184157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.185512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.185656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.185959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:32.186337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:32.187494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:32.188086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:32.199523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 959/1934] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:32.213068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 976/1935] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:32.217216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:32.236266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c4c76-8132-496f-9c68-596c09f61045 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:32.254046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83dab4-43aa-41f6-a8e2-32305ce8a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:32.255030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83dab4-43aa-41f6-a8e2-32305ce8a69e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.255729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83dab4-43aa-41f6-a8e2-32305ce8a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.256142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83dab4-43aa-41f6-a8e2-32305ce8a69e admin admin] PATH_INFO: `/v3/projects/cfda5e86bd3944a48eade2410e6871a1/users/4fa3654358d94e05aa0486b905d5407d/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.273165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:32.276634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:32.287223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83dab4-43aa-41f6-a8e2-32305ce8a69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfda5e86bd3944a48eade2410e6871a1, user_id=4fa3654358d94e05aa0486b905d5407d, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:32.293272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7759d-1414-4294-be15-2f1c015c2955 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:32.295089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83dab4-43aa-41f6-a8e2-32305ce8a69e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:32.300282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:32.301900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.302633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.303052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] PATH_INFO: `/v3/users/526fa40452964693b5255f1f287397bb` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.305587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=526fa40452964693b5255f1f287397bb)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:32.308675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:32.320152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 960/1936] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:32 2022] PUT /identity/v3/projects/cfda5e86bd3944a48eade2410e6871a1/users/4fa3654358d94e05aa0486b905d5407d/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:32.332031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11bcc-b613-45fd-8a7b-2aacecd9a91d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.332842 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11bcc-b613-45fd-8a7b-2aacecd9a91d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.333530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11bcc-b613-45fd-8a7b-2aacecd9a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.379285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526fa40452964693b5255f1f287397bb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:32.379995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526fa40452964693b5255f1f287397bb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:32.386231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-61e11bcc-b613-45fd-8a7b-2aacecd9a91d None None] MFA Rules not processed for user `4fa3654358d94e05aa0486b905d5407d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:32.387885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-61e11bcc-b613-45fd-8a7b-2aacecd9a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:32.403120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526fa40452964693b5255f1f287397bb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:32.411614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526fa40452964693b5255f1f287397bb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:32.413131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:32.420979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ca8e5fc6-eabb-49bc-b626-dff5116fea3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526fa40452964693b5255f1f287397bb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:32.428083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 977/1937] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:32 2022] DELETE /identity/v3/users/526fa40452964693b5255f1f287397bb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:32.433590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a198-93ff-4df9-b65b-b91f4e53101f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.433928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a198-93ff-4df9-b65b-b91f4e53101f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.434320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a198-93ff-4df9-b65b-b91f4e53101f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.455278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f1b2a198-93ff-4df9-b65b-b91f4e53101f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:32.456682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f1b2a198-93ff-4df9-b65b-b91f4e53101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:32.477549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 961/1938] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:32.487038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11bcc-b613-45fd-8a7b-2aacecd9a91d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:32.506034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-61e11bcc-b613-45fd-8a7b-2aacecd9a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:32.560135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 978/1939] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:32.572157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a198-93ff-4df9-b65b-b91f4e53101f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:32.575801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f1b2a198-93ff-4df9-b65b-b91f4e53101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:32.608398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:32.726366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a198-93ff-4df9-b65b-b91f4e53101f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:32.733861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:32.734720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.735149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.735455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.765793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11bcc-b613-45fd-8a7b-2aacecd9a91d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:32.774171 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:32.774679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:32.801195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 979/1940] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:32.829275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f45db0ea864a3299cccd7a74b7271b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:32.830403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:32.830875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:32.831272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:32.910910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:32.912714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:32.925871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 962/1941] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:33.169771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:33.171236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:33.194893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173dfd-9598-4103-925e-782dd691a39d service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:33.203419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:33.204082 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:33.204368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:33.204647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] PATH_INFO: `/v3/projects/9b1e5dcf25a945469affc0b3dc92eb00` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:33.206876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1e5dcf25a945469affc0b3dc92eb00)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:33.209280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:33.278495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1e5dcf25a945469affc0b3dc92eb00', 'request_id': 'req-f9fc724e-5d87-44fa-9013-f81306726c22'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.288081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1e5dcf25a945469affc0b3dc92eb00', 'request_id': 'req-f9fc724e-5d87-44fa-9013-f81306726c22'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.310489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1e5dcf25a945469affc0b3dc92eb00', 'request_id': 'req-f9fc724e-5d87-44fa-9013-f81306726c22'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.319455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:33.321913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:33.337510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a84c0-5f00-4e53-a149-96ce9768f4b2 service glance] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:33.338741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] The token cache is being invalidate because project 9b1e5dcf25a945469affc0b3dc92eb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:33.339105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.340666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.342355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 980/1942] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:33 2022] DELETE /identity/v3/projects/9b1e5dcf25a945469affc0b3dc92eb00 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:33.346712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:33.348542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:33.351840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:33.484648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:33.485438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:33.485727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:33.486002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] PATH_INFO: `/v3/users/2c29e2f0617f4e0c918bdf5a73453f23` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:33.487334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c29e2f0617f4e0c918bdf5a73453f23)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:33.489437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:33.545206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc724e-5d87-44fa-9013-f81306726c22 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:33.558454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:33.560625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:33.560945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:33.562022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] PATH_INFO: `/v3/users/a3905c0563a24c43818834791b6f0e86` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:33.564886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3905c0563a24c43818834791b6f0e86)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:33.567452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:33.613245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c29e2f0617f4e0c918bdf5a73453f23'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.643913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c29e2f0617f4e0c918bdf5a73453f23'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.669711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:33.669850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c29e2f0617f4e0c918bdf5a73453f23'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.689848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c29e2f0617f4e0c918bdf5a73453f23'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.689848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-46b3ad94-de10-4e63-852e-da5b62ff4d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c29e2f0617f4e0c918bdf5a73453f23'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.703047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 963/1943] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:33 2022] DELETE /identity/v3/users/2c29e2f0617f4e0c918bdf5a73453f23 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:33.705016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3905c0563a24c43818834791b6f0e86'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.707575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3905c0563a24c43818834791b6f0e86'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.708160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620f7f-addb-48c9-8dd0-c1cece3dbe3d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:33.708450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620f7f-addb-48c9-8dd0-c1cece3dbe3d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:33.708729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620f7f-addb-48c9-8dd0-c1cece3dbe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:33.754203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3905c0563a24c43818834791b6f0e86'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.767507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a8620f7f-addb-48c9-8dd0-c1cece3dbe3d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:33.768815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a8620f7f-addb-48c9-8dd0-c1cece3dbe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:33.772198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3905c0563a24c43818834791b6f0e86'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.807042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3905c0563a24c43818834791b6f0e86'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:33.838474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 981/1944] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:33 2022] DELETE /identity/v3/users/a3905c0563a24c43818834791b6f0e86 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:33.974410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 964/1945] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:34.019264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:34.021137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:34.163021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4651a4-dea7-46ff-86ac-73c43794f63f admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:34.167999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f260ca-8b6b-4b6b-8c04-c9a8baa1f0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:34.168858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f260ca-8b6b-4b6b-8c04-c9a8baa1f0cd service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:34.169414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f260ca-8b6b-4b6b-8c04-c9a8baa1f0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:34.169774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f260ca-8b6b-4b6b-8c04-c9a8baa1f0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:34.313063 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f260ca-8b6b-4b6b-8c04-c9a8baa1f0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:34.314472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f260ca-8b6b-4b6b-8c04-c9a8baa1f0cd service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:34.327714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 982/1946] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:34.408654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620f7f-addb-48c9-8dd0-c1cece3dbe3d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:34.411079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a8620f7f-addb-48c9-8dd0-c1cece3dbe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:34.425548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620f7f-addb-48c9-8dd0-c1cece3dbe3d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:34.431864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:34.432589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:34.432884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:34.433189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] PATH_INFO: `/v3/projects/bacdf06d08aa45ca8ae08ac7ce543b8a` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:34.436935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacdf06d08aa45ca8ae08ac7ce543b8a)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:34.436935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:34.474819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:34.500183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacdf06d08aa45ca8ae08ac7ce543b8a', 'request_id': 'req-5e324d16-f8a3-478d-b402-2a220812d7f5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.508776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacdf06d08aa45ca8ae08ac7ce543b8a', 'request_id': 'req-5e324d16-f8a3-478d-b402-2a220812d7f5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.514907 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacdf06d08aa45ca8ae08ac7ce543b8a', 'request_id': 'req-5e324d16-f8a3-478d-b402-2a220812d7f5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.531601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] The token cache is being invalidate because project bacdf06d08aa45ca8ae08ac7ce543b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:34.531895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.532554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-5e324d16-f8a3-478d-b402-2a220812d7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.534136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 965/1947] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:34 2022] DELETE /identity/v3/projects/bacdf06d08aa45ca8ae08ac7ce543b8a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:34.539881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255099cc-69e2-4b7d-94f2-1fa981330399 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:34.540173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255099cc-69e2-4b7d-94f2-1fa981330399 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:34.540522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255099cc-69e2-4b7d-94f2-1fa981330399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:34.573715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-255099cc-69e2-4b7d-94f2-1fa981330399 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:34.575115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-255099cc-69e2-4b7d-94f2-1fa981330399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:34.658629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 983/1948] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:34.667949 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dcd24-cf2a-44b9-990b-b2d73f74c565 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:34.668987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dcd24-cf2a-44b9-990b-b2d73f74c565 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:34.669308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3dcd24-cf2a-44b9-990b-b2d73f74c565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:34.699700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255099cc-69e2-4b7d-94f2-1fa981330399 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:34.700024 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6d3dcd24-cf2a-44b9-990b-b2d73f74c565 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:34.702164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-255099cc-69e2-4b7d-94f2-1fa981330399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:34.708874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6d3dcd24-cf2a-44b9-990b-b2d73f74c565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:34.716269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255099cc-69e2-4b7d-94f2-1fa981330399 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:34.721076 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:34.723086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:34.723086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:34.723086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] PATH_INFO: `/v3/projects/f9a1fa7ec93f4529ba1a1fa56a4cda91` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:34.723488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a1fa7ec93f4529ba1a1fa56a4cda91)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:34.725602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:34.729176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 966/1949] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:34.729310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:34.730270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dcd24-cf2a-44b9-990b-b2d73f74c565 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:34.748666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3dcd24-cf2a-44b9-990b-b2d73f74c565 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:34.757576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:34.758363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:34.758363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:34.758586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:34.759208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:34.759518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:34.761243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:34.779063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 967/1950] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:19:34.780108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:34.802266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a1fa7ec93f4529ba1a1fa56a4cda91', 'request_id': 'req-499a123b-ecdd-4605-bf44-c40bec87fb32'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.812326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a1fa7ec93f4529ba1a1fa56a4cda91', 'request_id': 'req-499a123b-ecdd-4605-bf44-c40bec87fb32'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.815931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7ca3d-7673-46cf-906b-c3ebccaa22d4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:34.823326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a1fa7ec93f4529ba1a1fa56a4cda91', 'request_id': 'req-499a123b-ecdd-4605-bf44-c40bec87fb32'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.846330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] The token cache is being invalidate because project f9a1fa7ec93f4529ba1a1fa56a4cda91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:34.846975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.848687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:34.855215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 984/1951] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:34 2022] DELETE /identity/v3/projects/f9a1fa7ec93f4529ba1a1fa56a4cda91 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:34.856922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:34.859742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:34.888594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:34.889280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:34.889589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:34.889864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:34.890976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:34.894201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:34.942225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 968/1952] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:34 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:34.946850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:34.949491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:34.960086 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a123b-ecdd-4605-bf44-c40bec87fb32 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:35.040125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5396969-a34b-4052-8016-28a8e8076d25 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:35.046653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acafbd1-e4fb-421f-b872-fab14000e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:35.047284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafbd1-e4fb-421f-b872-fab14000e9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.047789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafbd1-e4fb-421f-b872-fab14000e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.048354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafbd1-e4fb-421f-b872-fab14000e9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.048715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acafbd1-e4fb-421f-b872-fab14000e9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:35.051020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acafbd1-e4fb-421f-b872-fab14000e9e7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:35.057387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:35.058227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.059340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.059968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] PATH_INFO: `/v3/users/5e9f40fc125b489a85efc410b5916c5e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.061404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9f40fc125b489a85efc410b5916c5e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:35.063714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:35.084248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 969/1953] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:34 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:35.088433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acafbd1-e4fb-421f-b872-fab14000e9e7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:35.123438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acafbd1-e4fb-421f-b872-fab14000e9e7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:35.139540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:35.140091 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.140373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.140647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.141335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:35.143046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:35.143232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:35.144674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:35.161619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9f40fc125b489a85efc410b5916c5e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.164169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9f40fc125b489a85efc410b5916c5e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.171901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 970/1954] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:35.172918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:35.175399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:35.189373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9f40fc125b489a85efc410b5916c5e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.207076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da24168-0547-4ba4-9591-5a6333bbf9b4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:35.213353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:35.214213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.214666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.215135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] PATH_INFO: `/v3/users/09247dc0133b4b46a55e20afb8f53813` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.216747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09247dc0133b4b46a55e20afb8f53813)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:35.219014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:35.228728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9f40fc125b489a85efc410b5916c5e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.254340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9f40fc125b489a85efc410b5916c5e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.273462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 985/1955] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:34 2022] DELETE /identity/v3/users/5e9f40fc125b489a85efc410b5916c5e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:35.274520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:35.293577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:35.310786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09247dc0133b4b46a55e20afb8f53813'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.339923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09247dc0133b4b46a55e20afb8f53813'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.353829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09247dc0133b4b46a55e20afb8f53813'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.393622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09247dc0133b4b46a55e20afb8f53813'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.394404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-eb4c74d0-d76e-4899-8079-127637d01af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09247dc0133b4b46a55e20afb8f53813'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:35.406999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 971/1956] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:35 2022] DELETE /identity/v3/users/09247dc0133b4b46a55e20afb8f53813 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:35.408861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6c60-fbf1-46d1-86ce-a8ce321fba49 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.409640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6c60-fbf1-46d1-86ce-a8ce321fba49 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.409640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6c60-fbf1-46d1-86ce-a8ce321fba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.433676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f18adf-32cf-4f05-a517-a7e59666d833 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:35.435645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f78c6c60-fbf1-46d1-86ce-a8ce321fba49 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:35.437301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f78c6c60-fbf1-46d1-86ce-a8ce321fba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:35.547841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 972/1957] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:35.553904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6c60-fbf1-46d1-86ce-a8ce321fba49 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:35.555558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f78c6c60-fbf1-46d1-86ce-a8ce321fba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:35.590898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:35.591649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.591989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.592320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.606788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:35.609290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:35.628411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 986/1958] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:35.632478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:35.635472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:35.676315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1246-9d6b-4000-95c3-7e56e95189f0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:35.709779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:35.710521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.714033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.715269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] PATH_INFO: `/v3/projects/7f9200185d15456f99b4f39c3b4104f3/users/e8f57b4bdcbb4bb291ff8c34308410ea/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.754002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9200185d15456f99b4f39c3b4104f3, user_id=e8f57b4bdcbb4bb291ff8c34308410ea, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:35.760029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:35.802238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6c60-fbf1-46d1-86ce-a8ce321fba49 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:35.809205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 987/1959] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:35 2022] PUT /identity/v3/projects/7f9200185d15456f99b4f39c3b4104f3/users/e8f57b4bdcbb4bb291ff8c34308410ea/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:35.812069 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:35.814002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:35.878206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:35.894046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:35.947491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28719b-23b9-4b78-8780-489349f36780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:35.948469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28719b-23b9-4b78-8780-489349f36780 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.948820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28719b-23b9-4b78-8780-489349f36780 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.949397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28719b-23b9-4b78-8780-489349f36780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.968827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28719b-23b9-4b78-8780-489349f36780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:35.971176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28719b-23b9-4b78-8780-489349f36780 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:35.971344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f400da3-9170-4839-9757-1b3162a364a9 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:35.983957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 973/1960] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:35.986033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daae347-e587-4399-af67-e4c99afbd7cb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.986425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daae347-e587-4399-af67-e4c99afbd7cb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.987044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daae347-e587-4399-af67-e4c99afbd7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.987497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:35.988241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:35.988740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:35.988919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] PATH_INFO: `/v3/projects/91767f3ef87748c0a23a560772b424ca` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:35.990266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91767f3ef87748c0a23a560772b424ca)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:35.992943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.017625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3daae347-e587-4399-af67-e4c99afbd7cb None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:36.019084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3daae347-e587-4399-af67-e4c99afbd7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:36.030383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 974/1961] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:36.051214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daae347-e587-4399-af67-e4c99afbd7cb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.054270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3daae347-e587-4399-af67-e4c99afbd7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:36.069005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daae347-e587-4399-af67-e4c99afbd7cb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:36.069304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91767f3ef87748c0a23a560772b424ca', 'request_id': 'req-51d7f2d2-4616-4c37-a029-abf33639e7d9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.078321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91767f3ef87748c0a23a560772b424ca', 'request_id': 'req-51d7f2d2-4616-4c37-a029-abf33639e7d9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.090119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91767f3ef87748c0a23a560772b424ca', 'request_id': 'req-51d7f2d2-4616-4c37-a029-abf33639e7d9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.118683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] The token cache is being invalidate because project 91767f3ef87748c0a23a560772b424ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:36.119043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.119925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51d7f2d2-4616-4c37-a029-abf33639e7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.136151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 988/1962] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:35 2022] DELETE /identity/v3/projects/91767f3ef87748c0a23a560772b424ca => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:36.142441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdc6a-af98-4e8a-89a9-cc61a553fc8d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.142718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdc6a-af98-4e8a-89a9-cc61a553fc8d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.143013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdc6a-af98-4e8a-89a9-cc61a553fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.172748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:36.173748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-540cdc6a-af98-4e8a-89a9-cc61a553fc8d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:36.174245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.174568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.174848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.176807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-540cdc6a-af98-4e8a-89a9-cc61a553fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:36.177712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:36.290190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 989/1963] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:36.299635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e579-ba84-4ec3-b749-a76d4d701585 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.299926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e579-ba84-4ec3-b749-a76d4d701585 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.300263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e579-ba84-4ec3-b749-a76d4d701585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.318768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:36.320840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.339833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 975/1964] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:36.345125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-2a53e579-ba84-4ec3-b749-a76d4d701585 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:36.346628 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2a53e579-ba84-4ec3-b749-a76d4d701585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:36.356940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 990/1965] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:36.361526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.372447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c481c-b0b7-4ccf-b089-8f1a78032ccf service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:36.377709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:36.378403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.378771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.379115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.379860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:36.380281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:36.382985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.407429 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 976/1966] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:36.408670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53e579-ba84-4ec3-b749-a76d4d701585 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.421689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53e579-ba84-4ec3-b749-a76d4d701585 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:36.427866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c7469-9691-4f8d-95df-1165f1ac7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:36.428570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c7469-9691-4f8d-95df-1165f1ac7885 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.429810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c7469-9691-4f8d-95df-1165f1ac7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.429810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c7469-9691-4f8d-95df-1165f1ac7885 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.430216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c7469-9691-4f8d-95df-1165f1ac7885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:36.433164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c7469-9691-4f8d-95df-1165f1ac7885 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.469246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 991/1967] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:36 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:36.475168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.492661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73888d-60c4-4853-8ab1-d11a57b8cd0b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:36.576892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:36.585926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15991fee-9f81-4064-a8a0-0190872867cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:36.586814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991fee-9f81-4064-a8a0-0190872867cd admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.587272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991fee-9f81-4064-a8a0-0190872867cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.587855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15991fee-9f81-4064-a8a0-0190872867cd admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.588690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15991fee-9f81-4064-a8a0-0190872867cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:36.590868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15991fee-9f81-4064-a8a0-0190872867cd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.621183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 977/1968] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:36 2022] POST /identity/v3/users => generated 301 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:36.622469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c7469-9691-4f8d-95df-1165f1ac7885 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.637369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c7469-9691-4f8d-95df-1165f1ac7885 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:36.646674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:36.648361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.648801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.649643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.649937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:36.651961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.670466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 992/1969] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:36.671232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15991fee-9f81-4064-a8a0-0190872867cd admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.683479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.687767 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:36.708715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15991fee-9f81-4064-a8a0-0190872867cd admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:36.725284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6206f-da13-47c6-83e8-2cb991e9e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:36.725916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6206f-da13-47c6-83e8-2cb991e9e259 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.726206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6206f-da13-47c6-83e8-2cb991e9e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.726551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6206f-da13-47c6-83e8-2cb991e9e259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.727672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6206f-da13-47c6-83e8-2cb991e9e259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:36.729488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6206f-da13-47c6-83e8-2cb991e9e259 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.749013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb44c01-8294-4eac-b484-d7d2b1a22d69 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:36.755846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:36.756951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.757766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.758244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] PATH_INFO: `/v3/projects/564dcfd905724f6c88cd01a38242c145` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.760236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=564dcfd905724f6c88cd01a38242c145)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:36.763017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.773577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 978/1970] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:36.776050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6206f-da13-47c6-83e8-2cb991e9e259 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.793425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6206f-da13-47c6-83e8-2cb991e9e259 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:36.800821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70edc94-88d2-4537-9ded-16dee533b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:36.801533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70edc94-88d2-4537-9ded-16dee533b6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.801865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70edc94-88d2-4537-9ded-16dee533b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.802176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70edc94-88d2-4537-9ded-16dee533b6e9 admin admin] PATH_INFO: `/v3/projects/28dd885c6d0243ba91a19a554b4ca91a/users/3e883793e9c4409f9dd529ffe50c7184/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.816657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:36.819973 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70edc94-88d2-4537-9ded-16dee533b6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dd885c6d0243ba91a19a554b4ca91a, user_id=3e883793e9c4409f9dd529ffe50c7184, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:36.823575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70edc94-88d2-4537-9ded-16dee533b6e9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:36.851756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 979/1971] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:36 2022] PUT /identity/v3/projects/28dd885c6d0243ba91a19a554b4ca91a/users/3e883793e9c4409f9dd529ffe50c7184/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:36.863618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d046-6de4-475c-a19e-956c7464f2f9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:36.864197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d046-6de4-475c-a19e-956c7464f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:36.864506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d046-6de4-475c-a19e-956c7464f2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:36.880595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '564dcfd905724f6c88cd01a38242c145', 'request_id': 'req-457aa9bf-f4c2-4c44-8752-127350afc3b4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.890136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '564dcfd905724f6c88cd01a38242c145', 'request_id': 'req-457aa9bf-f4c2-4c44-8752-127350afc3b4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.903698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '564dcfd905724f6c88cd01a38242c145', 'request_id': 'req-457aa9bf-f4c2-4c44-8752-127350afc3b4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.911710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c0a5d046-6de4-475c-a19e-956c7464f2f9 None None] MFA Rules not processed for user `3e883793e9c4409f9dd529ffe50c7184`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:36.913323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c0a5d046-6de4-475c-a19e-956c7464f2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:36.922657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] The token cache is being invalidate because project 564dcfd905724f6c88cd01a38242c145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:36.922944 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.923973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:36.929385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 993/1972] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:36 2022] DELETE /identity/v3/projects/564dcfd905724f6c88cd01a38242c145 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:36.930412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:36.934357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:37.009770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 980/1973] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:37.014634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d046-6de4-475c-a19e-956c7464f2f9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.016027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c0a5d046-6de4-475c-a19e-956c7464f2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:37.034179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d046-6de4-475c-a19e-956c7464f2f9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.036885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457aa9bf-f4c2-4c44-8752-127350afc3b4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.039275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018198d3-4ccf-4f1e-91d0-0002f226082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.039894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018198d3-4ccf-4f1e-91d0-0002f226082a admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.040222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018198d3-4ccf-4f1e-91d0-0002f226082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.040439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018198d3-4ccf-4f1e-91d0-0002f226082a admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.041206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018198d3-4ccf-4f1e-91d0-0002f226082a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.043177 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018198d3-4ccf-4f1e-91d0-0002f226082a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.045473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.046729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.047390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.047390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] PATH_INFO: `/v3/users/890ba021fa9e41f59f04662d5e864cc5` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.049101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] RBAC: Authorizing `identity:delete_user(user_id=890ba021fa9e41f59f04662d5e864cc5)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.050944 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.080856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 981/1974] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:37 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:37.085216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018198d3-4ccf-4f1e-91d0-0002f226082a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.131968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890ba021fa9e41f59f04662d5e864cc5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:37.132886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890ba021fa9e41f59f04662d5e864cc5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:37.164942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890ba021fa9e41f59f04662d5e864cc5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:37.183674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890ba021fa9e41f59f04662d5e864cc5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:37.208678 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890ba021fa9e41f59f04662d5e864cc5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:37.216794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018198d3-4ccf-4f1e-91d0-0002f226082a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.222080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 994/1975] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:36 2022] DELETE /identity/v3/users/890ba021fa9e41f59f04662d5e864cc5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:37.226002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faece-06df-4970-9454-55eb6f6270d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.226793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faece-06df-4970-9454-55eb6f6270d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.227293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faece-06df-4970-9454-55eb6f6270d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.227672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2faece-06df-4970-9454-55eb6f6270d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.229158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2faece-06df-4970-9454-55eb6f6270d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.232662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2faece-06df-4970-9454-55eb6f6270d9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.260308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 982/1976] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:37 2022] POST /identity/v3/users => generated 306 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:37.264602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.266312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:37.303609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:37.390751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a939b-7a5a-494f-9846-00b6eba2557f admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.396214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d4397-87e5-404b-b12a-02486402bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.397277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d4397-87e5-404b-b12a-02486402bad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.397928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d4397-87e5-404b-b12a-02486402bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.399010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d4397-87e5-404b-b12a-02486402bad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.400487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d4397-87e5-404b-b12a-02486402bad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.401846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d4397-87e5-404b-b12a-02486402bad9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.425843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 995/1977] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:37.430382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faece-06df-4970-9454-55eb6f6270d9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.434224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35ab6-9875-4392-bdce-677d698e140c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.434510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35ab6-9875-4392-bdce-677d698e140c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.434953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd35ab6-9875-4392-bdce-677d698e140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.445738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2faece-06df-4970-9454-55eb6f6270d9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.451612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf7ab-40d0-4665-a30b-f82f876b8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.452673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf7ab-40d0-4665-a30b-f82f876b8219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.453282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf7ab-40d0-4665-a30b-f82f876b8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.454395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf7ab-40d0-4665-a30b-f82f876b8219 admin admin] PATH_INFO: `/v3/projects/ca9c0f79609641cd95d8408fdae0274f/users/8030aab1ceb248d6bd95d9e817e25028/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.458607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:37.471701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4dd35ab6-9875-4392-bdce-677d698e140c None None] MFA Rules not processed for user `e8f57b4bdcbb4bb291ff8c34308410ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:37.473012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4dd35ab6-9875-4392-bdce-677d698e140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:37.490169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cf7ab-40d0-4665-a30b-f82f876b8219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9c0f79609641cd95d8408fdae0274f, user_id=8030aab1ceb248d6bd95d9e817e25028, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.494515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cf7ab-40d0-4665-a30b-f82f876b8219 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.533878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 983/1978] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:37 2022] PUT /identity/v3/projects/ca9c0f79609641cd95d8408fdae0274f/users/8030aab1ceb248d6bd95d9e817e25028/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:37.535169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf7ab-40d0-4665-a30b-f82f876b8219 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.623615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 996/1979] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:37.627729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd35ab6-9875-4392-bdce-677d698e140c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.629159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4dd35ab6-9875-4392-bdce-677d698e140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:37.644920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd35ab6-9875-4392-bdce-677d698e140c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.662836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf7ab-40d0-4665-a30b-f82f876b8219 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.675953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10288645-6a31-437c-a9b6-2cc18c4e472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.676632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288645-6a31-437c-a9b6-2cc18c4e472b admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.676914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288645-6a31-437c-a9b6-2cc18c4e472b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.677241 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10288645-6a31-437c-a9b6-2cc18c4e472b admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.677902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10288645-6a31-437c-a9b6-2cc18c4e472b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.679737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10288645-6a31-437c-a9b6-2cc18c4e472b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.696434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 984/1980] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:37.697495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10288645-6a31-437c-a9b6-2cc18c4e472b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.712580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10288645-6a31-437c-a9b6-2cc18c4e472b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.718679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03655b-64b4-488c-8d8a-f04fc6442337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.719627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03655b-64b4-488c-8d8a-f04fc6442337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.719984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03655b-64b4-488c-8d8a-f04fc6442337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.720261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03655b-64b4-488c-8d8a-f04fc6442337 admin admin] PATH_INFO: `/v3/projects/ca9c0f79609641cd95d8408fdae0274f/users/8030aab1ceb248d6bd95d9e817e25028/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.723653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03655b-64b4-488c-8d8a-f04fc6442337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9c0f79609641cd95d8408fdae0274f, user_id=8030aab1ceb248d6bd95d9e817e25028, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.728221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03655b-64b4-488c-8d8a-f04fc6442337 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.733556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810238d8-df6b-40c8-8e50-e662895906c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.734283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810238d8-df6b-40c8-8e50-e662895906c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.734871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810238d8-df6b-40c8-8e50-e662895906c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.735146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810238d8-df6b-40c8-8e50-e662895906c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.736642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810238d8-df6b-40c8-8e50-e662895906c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.739016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810238d8-df6b-40c8-8e50-e662895906c8 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.740201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 985/1981] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:37 2022] PUT /identity/v3/projects/ca9c0f79609641cd95d8408fdae0274f/users/8030aab1ceb248d6bd95d9e817e25028/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:37.754284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14334-8a68-484b-948b-4acf92d9dd1b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.754596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14334-8a68-484b-948b-4acf92d9dd1b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.755002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af14334-8a68-484b-948b-4acf92d9dd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.779851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 997/1982] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:37 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:37.782081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810238d8-df6b-40c8-8e50-e662895906c8 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.790401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2af14334-8a68-484b-948b-4acf92d9dd1b None None] MFA Rules not processed for user `8030aab1ceb248d6bd95d9e817e25028`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:37.791857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2af14334-8a68-484b-948b-4acf92d9dd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:37.842693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:37.875891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810238d8-df6b-40c8-8e50-e662895906c8 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.882015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60725d4-2b94-4cbe-b394-12a60edd6c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.882636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60725d4-2b94-4cbe-b394-12a60edd6c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.883021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60725d4-2b94-4cbe-b394-12a60edd6c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.883406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60725d4-2b94-4cbe-b394-12a60edd6c6f admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.883929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60725d4-2b94-4cbe-b394-12a60edd6c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.886432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60725d4-2b94-4cbe-b394-12a60edd6c6f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:37.931619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 986/1983] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:37.939500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af14334-8a68-484b-948b-4acf92d9dd1b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.941026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2af14334-8a68-484b-948b-4acf92d9dd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:37.945897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 998/1984] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:37 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:37.950121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60725d4-2b94-4cbe-b394-12a60edd6c6f admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:37.962548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60725d4-2b94-4cbe-b394-12a60edd6c6f admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:37.967499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:37.971338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:37.972048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:37.972161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:37.972941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:37.974683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.009302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 999/1985] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:38.009302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.009302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:38.028102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115e6e-9d0b-43a9-ac22-e45f90d40ea1 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.035538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.036262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.036604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.037346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] PATH_INFO: `/v3/projects/1b9121f17c3b470ebfa8e348c76c8d7d` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.039127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9121f17c3b470ebfa8e348c76c8d7d)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.041184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.056895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af14334-8a68-484b-948b-4acf92d9dd1b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.066291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afa025-6c21-4a88-a79b-d2002b740017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.066982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afa025-6c21-4a88-a79b-d2002b740017 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.067267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afa025-6c21-4a88-a79b-d2002b740017 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.067543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afa025-6c21-4a88-a79b-d2002b740017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.086046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afa025-6c21-4a88-a79b-d2002b740017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.087591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afa025-6c21-4a88-a79b-d2002b740017 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.091789 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:38.101532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 987/1986] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:38.102375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afa025-6c21-4a88-a79b-d2002b740017 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.114119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9121f17c3b470ebfa8e348c76c8d7d', 'request_id': 'req-559c00e8-851f-4697-bc01-8b5cd315d5ff'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:38.115122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afa025-6c21-4a88-a79b-d2002b740017 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.123188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9121f17c3b470ebfa8e348c76c8d7d', 'request_id': 'req-559c00e8-851f-4697-bc01-8b5cd315d5ff'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:38.132349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9121f17c3b470ebfa8e348c76c8d7d', 'request_id': 'req-559c00e8-851f-4697-bc01-8b5cd315d5ff'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:38.155690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] The token cache is being invalidate because project 1b9121f17c3b470ebfa8e348c76c8d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:38.156104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:38.156901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-559c00e8-851f-4697-bc01-8b5cd315d5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:38.158633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1000/1987] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:38 2022] DELETE /identity/v3/projects/1b9121f17c3b470ebfa8e348c76c8d7d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:38.163888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531480c4-e131-4406-a689-aebbf2d05a65 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.164222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531480c4-e131-4406-a689-aebbf2d05a65 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.164463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531480c4-e131-4406-a689-aebbf2d05a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.203602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-531480c4-e131-4406-a689-aebbf2d05a65 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:38.204833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-531480c4-e131-4406-a689-aebbf2d05a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:38.219140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.219894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.220269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.220605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] PATH_INFO: `/v3/projects/fbe0cbe93feb4cf680cab681a6aa300e/users/a8b8b007ce2b4aa8b636a09e4eefe3b6/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.237872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe0cbe93feb4cf680cab681a6aa300e, user_id=a8b8b007ce2b4aa8b636a09e4eefe3b6, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.240607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.254186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 988/1988] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:38 2022] PUT /identity/v3/projects/fbe0cbe93feb4cf680cab681a6aa300e/users/a8b8b007ce2b4aa8b636a09e4eefe3b6/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:38.254993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.256490 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:38.269893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1001/1989] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:38.277404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531480c4-e131-4406-a689-aebbf2d05a65 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.278830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-531480c4-e131-4406-a689-aebbf2d05a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:38.290526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531480c4-e131-4406-a689-aebbf2d05a65 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.318166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288cec-4bbe-48a0-ac6b-955b89421bb8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.321982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.322603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.322877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.323146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.324944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:38.336257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:38.355125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43c267-e085-4f52-9608-62b5aa720c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.355738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43c267-e085-4f52-9608-62b5aa720c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.356012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43c267-e085-4f52-9608-62b5aa720c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.356278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43c267-e085-4f52-9608-62b5aa720c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.356955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43c267-e085-4f52-9608-62b5aa720c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.358599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43c267-e085-4f52-9608-62b5aa720c93 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.369336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1002/1990] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:38.370782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c162-b4c2-47b9-9763-3a2a78586585 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.370970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c162-b4c2-47b9-9763-3a2a78586585 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.371887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9c162-b4c2-47b9-9763-3a2a78586585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.384840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.386327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.392382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-aab9c162-b4c2-47b9-9763-3a2a78586585 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:38.393614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-aab9c162-b4c2-47b9-9763-3a2a78586585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:38.395334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 989/1991] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:38 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:38.395953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.402235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1003/1992] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:38.406373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9c162-b4c2-47b9-9763-3a2a78586585 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.406641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589120d-7ecf-4888-9f44-e523427ee48a service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.412268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1dfb6-5e63-4282-9713-39f18295a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.413114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1dfb6-5e63-4282-9713-39f18295a8be admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.413475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1dfb6-5e63-4282-9713-39f18295a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.413814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1dfb6-5e63-4282-9713-39f18295a8be admin admin] PATH_INFO: `/v3/projects/fbe0cbe93feb4cf680cab681a6aa300e/users/a8b8b007ce2b4aa8b636a09e4eefe3b6/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.415716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9c162-b4c2-47b9-9763-3a2a78586585 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.416349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1dfb6-5e63-4282-9713-39f18295a8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe0cbe93feb4cf680cab681a6aa300e, user_id=a8b8b007ce2b4aa8b636a09e4eefe3b6, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.419184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1dfb6-5e63-4282-9713-39f18295a8be admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.420277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.420871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.421188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.421482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.422339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:38.422645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.424538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.430998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 990/1993] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:38 2022] PUT /identity/v3/projects/fbe0cbe93feb4cf680cab681a6aa300e/users/a8b8b007ce2b4aa8b636a09e4eefe3b6/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:38.438536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1004/1994] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:19:38.443036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1dfb6-5e63-4282-9713-39f18295a8be admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.473907 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:38.524425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1dfb6-5e63-4282-9713-39f18295a8be admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.531239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f242a7d-0183-47eb-9efb-ef2080bd350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.532144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f242a7d-0183-47eb-9efb-ef2080bd350d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.532468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f242a7d-0183-47eb-9efb-ef2080bd350d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.532753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f242a7d-0183-47eb-9efb-ef2080bd350d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.533433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f242a7d-0183-47eb-9efb-ef2080bd350d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.536132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f242a7d-0183-47eb-9efb-ef2080bd350d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.602974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 991/1995] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:38 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:38.608670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.622577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf63b9-490c-421b-a0fe-412ff05bbe5f admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.783868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b4964-1a4d-45ef-9901-b2e97ab0cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.784587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b4964-1a4d-45ef-9901-b2e97ab0cd28 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.784904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b4964-1a4d-45ef-9901-b2e97ab0cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.785213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b4964-1a4d-45ef-9901-b2e97ab0cd28 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.785861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b4964-1a4d-45ef-9901-b2e97ab0cd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.789010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b4964-1a4d-45ef-9901-b2e97ab0cd28 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.840267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1005/1996] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:38 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:38.851140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f242a7d-0183-47eb-9efb-ef2080bd350d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.878074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f242a7d-0183-47eb-9efb-ef2080bd350d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.886774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61059249-be52-43e8-ab90-e9a873d8a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.887964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61059249-be52-43e8-ab90-e9a873d8a5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.890223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61059249-be52-43e8-ab90-e9a873d8a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.890223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61059249-be52-43e8-ab90-e9a873d8a5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.891160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61059249-be52-43e8-ab90-e9a873d8a5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.893794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61059249-be52-43e8-ab90-e9a873d8a5b1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.908948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 992/1997] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:38.912645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b4964-1a4d-45ef-9901-b2e97ab0cd28 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.926942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b4964-1a4d-45ef-9901-b2e97ab0cd28 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.943874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df038e-c68e-4b1b-a002-aef2cc7eeda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.944599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df038e-c68e-4b1b-a002-aef2cc7eeda4 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.945109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df038e-c68e-4b1b-a002-aef2cc7eeda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.945548 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df038e-c68e-4b1b-a002-aef2cc7eeda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:38.947084 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df038e-c68e-4b1b-a002-aef2cc7eeda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:38.947948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df038e-c68e-4b1b-a002-aef2cc7eeda4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:38.975594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1006/1998] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:19:38.980150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61059249-be52-43e8-ab90-e9a873d8a5b1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:38.990750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61059249-be52-43e8-ab90-e9a873d8a5b1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:38.996784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6adb93-9e11-429f-b5df-e4732f947ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:38.997504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6adb93-9e11-429f-b5df-e4732f947ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:38.997782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6adb93-9e11-429f-b5df-e4732f947ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:38.998073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6adb93-9e11-429f-b5df-e4732f947ab7 admin admin] PATH_INFO: `/v3/projects/bbe070896b6947ffbc27a22e96d19a13/users/ef6c0fa09eb94e688705d9b219b874c7/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.019458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6adb93-9e11-429f-b5df-e4732f947ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe070896b6947ffbc27a22e96d19a13, user_id=ef6c0fa09eb94e688705d9b219b874c7, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:39.023780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6adb93-9e11-429f-b5df-e4732f947ab7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:39.044222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 993/1999] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:38 2022] PUT /identity/v3/projects/bbe070896b6947ffbc27a22e96d19a13/users/ef6c0fa09eb94e688705d9b219b874c7/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:39.055187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f4b51-3de4-4706-b1b4-6dc79133c66d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.055471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f4b51-3de4-4706-b1b4-6dc79133c66d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.055741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f4b51-3de4-4706-b1b4-6dc79133c66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.135734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8d6f4b51-3de4-4706-b1b4-6dc79133c66d None None] MFA Rules not processed for user `ef6c0fa09eb94e688705d9b219b874c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:39.138022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8d6f4b51-3de4-4706-b1b4-6dc79133c66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:39.235126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1007/2000] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:39.240379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6adb93-9e11-429f-b5df-e4732f947ab7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:39.309406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6adb93-9e11-429f-b5df-e4732f947ab7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:39.314244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02c295-b568-48c8-9298-e624a52256df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:39.314857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c295-b568-48c8-9298-e624a52256df admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.315133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c295-b568-48c8-9298-e624a52256df admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.315404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02c295-b568-48c8-9298-e624a52256df admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.316038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02c295-b568-48c8-9298-e624a52256df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:39.318074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02c295-b568-48c8-9298-e624a52256df admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:39.366777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 994/2001] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:39 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:39.367265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f4b51-3de4-4706-b1b4-6dc79133c66d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:39.383576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f4b51-3de4-4706-b1b4-6dc79133c66d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:39.412460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:39.468387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7483ff-0cf0-4bee-9d24-39ee032632a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:39.469173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7483ff-0cf0-4bee-9d24-39ee032632a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.469553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7483ff-0cf0-4bee-9d24-39ee032632a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.469897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7483ff-0cf0-4bee-9d24-39ee032632a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.471561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7483ff-0cf0-4bee-9d24-39ee032632a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:39.475193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7483ff-0cf0-4bee-9d24-39ee032632a7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:39.492598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17770-449c-4387-92df-164f05963184 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.493072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17770-449c-4387-92df-164f05963184 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.493460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa17770-449c-4387-92df-164f05963184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.507276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1008/2002] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:39 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:39.511662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7483ff-0cf0-4bee-9d24-39ee032632a7 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:39.523455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7483ff-0cf0-4bee-9d24-39ee032632a7 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:39.529828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b549c38-082f-43b4-9919-2f7f1608f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:39.530722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549c38-082f-43b4-9919-2f7f1608f054 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.531080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549c38-082f-43b4-9919-2f7f1608f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.531597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b549c38-082f-43b4-9919-2f7f1608f054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.532428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b549c38-082f-43b4-9919-2f7f1608f054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:39.534225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b549c38-082f-43b4-9919-2f7f1608f054 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:39.547174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1009/2003] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:19:39.551100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b549c38-082f-43b4-9919-2f7f1608f054 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:39.557655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6aa17770-449c-4387-92df-164f05963184 None None] MFA Rules not processed for user `a8b8b007ce2b4aa8b636a09e4eefe3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:39.558918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6aa17770-449c-4387-92df-164f05963184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:39.563080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b549c38-082f-43b4-9919-2f7f1608f054 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:39.568675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fd67e-b3ec-41ec-946d-7dbd7eb2dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:39.569682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fd67e-b3ec-41ec-946d-7dbd7eb2dad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.569818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fd67e-b3ec-41ec-946d-7dbd7eb2dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.570125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fd67e-b3ec-41ec-946d-7dbd7eb2dad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.570841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fd67e-b3ec-41ec-946d-7dbd7eb2dad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:39.572690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fd67e-b3ec-41ec-946d-7dbd7eb2dad6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:39.589635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1010/2004] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:19:39.591259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fd67e-b3ec-41ec-946d-7dbd7eb2dad6 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:39.603749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fd67e-b3ec-41ec-946d-7dbd7eb2dad6 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:39.608672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9d318-f464-470a-888a-bba9a2ff9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:39.609369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9d318-f464-470a-888a-bba9a2ff9502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.609980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9d318-f464-470a-888a-bba9a2ff9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.609980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9d318-f464-470a-888a-bba9a2ff9502 admin admin] PATH_INFO: `/v3/projects/fafe628ff3104a2095c5a89812e9be09/users/4c675662bd0a48a1b5f6569692bb62b2/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.619254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:39.639531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9d318-f464-470a-888a-bba9a2ff9502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafe628ff3104a2095c5a89812e9be09, user_id=4c675662bd0a48a1b5f6569692bb62b2, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:39.646017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9d318-f464-470a-888a-bba9a2ff9502 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:39.661374 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 995/2005] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:39.666698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfae99-b5b9-4bc0-a3c5-2b9e7f32fc7b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.667109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfae99-b5b9-4bc0-a3c5-2b9e7f32fc7b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.667457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfae99-b5b9-4bc0-a3c5-2b9e7f32fc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.668102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1011/2006] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:39 2022] PUT /identity/v3/projects/fafe628ff3104a2095c5a89812e9be09/users/4c675662bd0a48a1b5f6569692bb62b2/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:39.679651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12c5e7-df62-410c-9242-5a2d947e42c6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.680021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12c5e7-df62-410c-9242-5a2d947e42c6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.680344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12c5e7-df62-410c-9242-5a2d947e42c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.695808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6dbfae99-b5b9-4bc0-a3c5-2b9e7f32fc7b None None] MFA Rules not processed for user `e8f57b4bdcbb4bb291ff8c34308410ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:39.697178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6dbfae99-b5b9-4bc0-a3c5-2b9e7f32fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:39.715639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9f12c5e7-df62-410c-9242-5a2d947e42c6 None None] MFA Rules not processed for user `4c675662bd0a48a1b5f6569692bb62b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:39.717685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9f12c5e7-df62-410c-9242-5a2d947e42c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:39.770834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 996/2007] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:39.785749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfae99-b5b9-4bc0-a3c5-2b9e7f32fc7b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:39.787680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6dbfae99-b5b9-4bc0-a3c5-2b9e7f32fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:39.829879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1012/2008] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:39.834279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12c5e7-df62-410c-9242-5a2d947e42c6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:39.951531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12c5e7-df62-410c-9242-5a2d947e42c6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:39.956276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfae99-b5b9-4bc0-a3c5-2b9e7f32fc7b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:39.961930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525939bc-58b7-42c2-ba02-e33236064289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:39.963246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525939bc-58b7-42c2-ba02-e33236064289 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.963623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525939bc-58b7-42c2-ba02-e33236064289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.964044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525939bc-58b7-42c2-ba02-e33236064289 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:39.965174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525939bc-58b7-42c2-ba02-e33236064289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:39.967326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525939bc-58b7-42c2-ba02-e33236064289 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:39.973906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:39.986562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:39.986562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:39.986562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:39.986562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:40.016149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:40.026999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1013/2009] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:39 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:40.031213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525939bc-58b7-42c2-ba02-e33236064289 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:40.050420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:40.053076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:40.065295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 997/2010] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:40.126614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525939bc-58b7-42c2-ba02-e33236064289 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:40.132231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2ba2-1d86-4334-bea3-af3019014709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:40.132926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2ba2-1d86-4334-bea3-af3019014709 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:40.133301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2ba2-1d86-4334-bea3-af3019014709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:40.133638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2ba2-1d86-4334-bea3-af3019014709 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:40.134338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2ba2-1d86-4334-bea3-af3019014709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:40.136821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2ba2-1d86-4334-bea3-af3019014709 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:40.171634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1014/2011] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:40 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:40.185519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:40.199932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cb922-dc5c-4180-a701-87c57e17436e service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:40.218123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478e45a-63e3-4a71-b521-b9e7ddb0ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:40.218846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e45a-63e3-4a71-b521-b9e7ddb0ad0b admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:40.219042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e45a-63e3-4a71-b521-b9e7ddb0ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:40.219315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478e45a-63e3-4a71-b521-b9e7ddb0ad0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:40.219991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478e45a-63e3-4a71-b521-b9e7ddb0ad0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:40.222215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478e45a-63e3-4a71-b521-b9e7ddb0ad0b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:40.264923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 998/2012] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:40.269344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2ba2-1d86-4334-bea3-af3019014709 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:40.292682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2ba2-1d86-4334-bea3-af3019014709 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:40.299514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3891555-8839-4460-9565-7e2555233fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:40.300376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3891555-8839-4460-9565-7e2555233fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:40.301553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3891555-8839-4460-9565-7e2555233fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:40.301951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3891555-8839-4460-9565-7e2555233fa4 admin admin] PATH_INFO: `/v3/projects/a0400357995f4d848f4ae63d09e28369/users/36af8090ed1840d9b2cd7a9ed80695b6/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:40.321320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3891555-8839-4460-9565-7e2555233fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0400357995f4d848f4ae63d09e28369, user_id=36af8090ed1840d9b2cd7a9ed80695b6, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:40.324864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3891555-8839-4460-9565-7e2555233fa4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:40.341392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1015/2013] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:40 2022] PUT /identity/v3/projects/a0400357995f4d848f4ae63d09e28369/users/36af8090ed1840d9b2cd7a9ed80695b6/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:40.345387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478e45a-63e3-4a71-b521-b9e7ddb0ad0b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:40.374275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478e45a-63e3-4a71-b521-b9e7ddb0ad0b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:40.464855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28333107-871c-46e1-a1a5-25969eafd05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:40.465736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333107-871c-46e1-a1a5-25969eafd05e admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:40.466543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333107-871c-46e1-a1a5-25969eafd05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:40.471650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28333107-871c-46e1-a1a5-25969eafd05e admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:40.472440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28333107-871c-46e1-a1a5-25969eafd05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:40.474182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28333107-871c-46e1-a1a5-25969eafd05e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:40.475743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:40.489910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 999/2014] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:40.494728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3891555-8839-4460-9565-7e2555233fa4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:40.507153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3891555-8839-4460-9565-7e2555233fa4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:40.512823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db042c8-3f8b-4db7-9d68-6c53b0b6a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:40.513542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db042c8-3f8b-4db7-9d68-6c53b0b6a8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:40.513856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db042c8-3f8b-4db7-9d68-6c53b0b6a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:40.514144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db042c8-3f8b-4db7-9d68-6c53b0b6a8f0 admin admin] PATH_INFO: `/v3/projects/a0400357995f4d848f4ae63d09e28369/users/36af8090ed1840d9b2cd7a9ed80695b6/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:40.529217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db042c8-3f8b-4db7-9d68-6c53b0b6a8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0400357995f4d848f4ae63d09e28369, user_id=36af8090ed1840d9b2cd7a9ed80695b6, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:40.534802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db042c8-3f8b-4db7-9d68-6c53b0b6a8f0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:40.592872 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1016/2015] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:40 2022] PUT /identity/v3/projects/a0400357995f4d848f4ae63d09e28369/users/36af8090ed1840d9b2cd7a9ed80695b6/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:40.605573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd46d51-5091-43e8-aecf-4f3c60870962 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:40.606549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd46d51-5091-43e8-aecf-4f3c60870962 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:40.607068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd46d51-5091-43e8-aecf-4f3c60870962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:40.666608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1dd46d51-5091-43e8-aecf-4f3c60870962 None None] MFA Rules not processed for user `36af8090ed1840d9b2cd7a9ed80695b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:40.668081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1dd46d51-5091-43e8-aecf-4f3c60870962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:40.765824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1000/2016] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:40.780080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db042c8-3f8b-4db7-9d68-6c53b0b6a8f0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:40.867143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db042c8-3f8b-4db7-9d68-6c53b0b6a8f0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:40.872560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:40.873556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:40.873998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:40.874432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:40.944722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:40.960581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:40.963008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:40.988160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1017/2017] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:42.769735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd46d51-5091-43e8-aecf-4f3c60870962 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:42.793066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd46d51-5091-43e8-aecf-4f3c60870962 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:42.832348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112729cb-ce96-4484-b904-1f06f41fd795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:42.833591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112729cb-ce96-4484-b904-1f06f41fd795 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:42.834115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112729cb-ce96-4484-b904-1f06f41fd795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:42.834537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112729cb-ce96-4484-b904-1f06f41fd795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:42.932328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112729cb-ce96-4484-b904-1f06f41fd795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:42.935199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112729cb-ce96-4484-b904-1f06f41fd795 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:42.951015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1001/2018] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:43.104185 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:43.105840 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:43.217786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087f866-ea00-4fde-89c8-fd3ba77d5401 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:43.223539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:43.224537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:43.225198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:43.227049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] PATH_INFO: `/v3/users/3e883793e9c4409f9dd529ffe50c7184` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:43.238700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e883793e9c4409f9dd529ffe50c7184)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:43.240859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:43.393244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e883793e9c4409f9dd529ffe50c7184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:43.394165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e883793e9c4409f9dd529ffe50c7184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:43.424064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e883793e9c4409f9dd529ffe50c7184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:43.447217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e883793e9c4409f9dd529ffe50c7184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:43.470698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e883793e9c4409f9dd529ffe50c7184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:43.486699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1018/2019] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:43 2022] DELETE /identity/v3/users/3e883793e9c4409f9dd529ffe50c7184 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:43.491510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7432e7-85d4-4b94-b749-f5fef7f87de5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:43.501582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7432e7-85d4-4b94-b749-f5fef7f87de5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:43.501582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7432e7-85d4-4b94-b749-f5fef7f87de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:43.564481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8a7432e7-85d4-4b94-b749-f5fef7f87de5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:43.568327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8a7432e7-85d4-4b94-b749-f5fef7f87de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:43.714519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1002/2020] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:43.726886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:43.729660 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:43.885639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a75b3-d0d7-451c-9ce5-4630bf60afa7 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:43.890235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:43.891118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:43.891530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:43.891916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:43.906546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:43.913197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:43.982148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1019/2021] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:44.140248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7432e7-85d4-4b94-b749-f5fef7f87de5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:44.141999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8a7432e7-85d4-4b94-b749-f5fef7f87de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:44.182017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:44.230152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7432e7-85d4-4b94-b749-f5fef7f87de5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:44.234349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:44.235424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:44.236017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:44.236445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:44.238454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:44.354459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:44.357270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:44.375982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1003/2022] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:44.502797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:44.504409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:44.556610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4562f-f326-4761-bffd-549f423634ee service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:44.573595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:44.574910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:44.575196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:44.575468 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] PATH_INFO: `/v3/projects/28dd885c6d0243ba91a19a554b4ca91a` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:44.577491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28dd885c6d0243ba91a19a554b4ca91a)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:44.580240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:44.604981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:44.692406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28dd885c6d0243ba91a19a554b4ca91a', 'request_id': 'req-47fed118-e476-44c8-be6d-c89c23b4ca55'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.700796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28dd885c6d0243ba91a19a554b4ca91a', 'request_id': 'req-47fed118-e476-44c8-be6d-c89c23b4ca55'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.710897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28dd885c6d0243ba91a19a554b4ca91a', 'request_id': 'req-47fed118-e476-44c8-be6d-c89c23b4ca55'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.737148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] The token cache is being invalidate because project 28dd885c6d0243ba91a19a554b4ca91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:44.737671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.738313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.740265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1020/2023] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:44 2022] DELETE /identity/v3/projects/28dd885c6d0243ba91a19a554b4ca91a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:44.744816 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:44.756567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bcb4a-1115-4b03-b48c-ab4ea08d559e service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:44.819151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:44.820165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:44.820454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:44.820730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] PATH_INFO: `/v3/users/8030aab1ceb248d6bd95d9e817e25028` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:44.821934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8030aab1ceb248d6bd95d9e817e25028)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:44.823873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:44.885551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8030aab1ceb248d6bd95d9e817e25028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.898459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8030aab1ceb248d6bd95d9e817e25028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.904317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:44.906777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8030aab1ceb248d6bd95d9e817e25028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.916438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8030aab1ceb248d6bd95d9e817e25028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.917531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-22c210e4-d212-4db6-8cfb-f68084a50274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8030aab1ceb248d6bd95d9e817e25028'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:44.926486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1004/2024] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:44 2022] DELETE /identity/v3/users/8030aab1ceb248d6bd95d9e817e25028 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:45.353848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:45.356389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:45.381652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fed118-e476-44c8-be6d-c89c23b4ca55 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:45.458664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:45.458664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:45.458965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:45.459134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] PATH_INFO: `/v3/projects/ca9c0f79609641cd95d8408fdae0274f` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:45.460601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9c0f79609641cd95d8408fdae0274f)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:45.462579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:45.533249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9c0f79609641cd95d8408fdae0274f', 'request_id': 'req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:45.539651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9c0f79609641cd95d8408fdae0274f', 'request_id': 'req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:45.546639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9c0f79609641cd95d8408fdae0274f', 'request_id': 'req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:45.573146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] The token cache is being invalidate because project ca9c0f79609641cd95d8408fdae0274f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:45.573146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:45.573146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ffffcc4c-9a1c-4ee0-aef9-a1575139c246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:45.575207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1021/2025] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:45 2022] DELETE /identity/v3/projects/ca9c0f79609641cd95d8408fdae0274f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:45.580186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ea0bf-4b17-4c92-ae0b-b79963bdb8f8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:45.580627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ea0bf-4b17-4c92-ae0b-b79963bdb8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:45.581327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ea0bf-4b17-4c92-ae0b-b79963bdb8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:45.603733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-408ea0bf-4b17-4c92-ae0b-b79963bdb8f8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:45.605310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-408ea0bf-4b17-4c92-ae0b-b79963bdb8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:45.715108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1005/2026] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:45.722719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cc57-f1cd-43d2-83e1-3194a34ac7ad None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:45.723008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cc57-f1cd-43d2-83e1-3194a34ac7ad None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:45.723290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2cc57-f1cd-43d2-83e1-3194a34ac7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:45.760710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-acc2cc57-f1cd-43d2-83e1-3194a34ac7ad None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:45.763254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-acc2cc57-f1cd-43d2-83e1-3194a34ac7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:45.792642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1022/2027] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:45.794276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ea0bf-4b17-4c92-ae0b-b79963bdb8f8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:45.815071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ea0bf-4b17-4c92-ae0b-b79963bdb8f8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:45.820918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:45.822163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:45.822641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:45.823013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:45.824395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:45.824819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:45.827227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:45.860565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1006/2028] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:19:45.862071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2cc57-f1cd-43d2-83e1-3194a34ac7ad None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:45.916145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2cc57-f1cd-43d2-83e1-3194a34ac7ad None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:45.933980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24199e-98b3-4f98-837f-a47c163ed5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:45.934892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24199e-98b3-4f98-837f-a47c163ed5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:45.935010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24199e-98b3-4f98-837f-a47c163ed5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:45.935245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24199e-98b3-4f98-837f-a47c163ed5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:45.936919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24199e-98b3-4f98-837f-a47c163ed5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:45.943379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24199e-98b3-4f98-837f-a47c163ed5b0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:45.999922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:46.013710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1023/2029] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:45 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:46.018752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:46.039801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4241e-8685-4bf3-9452-fa552f746d3f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:46.125111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda940da-430b-4e77-b30a-11ae437c59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:46.125755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda940da-430b-4e77-b30a-11ae437c59bb admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:46.126033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda940da-430b-4e77-b30a-11ae437c59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:46.126299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda940da-430b-4e77-b30a-11ae437c59bb admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:46.126958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda940da-430b-4e77-b30a-11ae437c59bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:46.128974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda940da-430b-4e77-b30a-11ae437c59bb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:46.163161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24199e-98b3-4f98-837f-a47c163ed5b0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:46.163353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1007/2030] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:46 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:46.174471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24199e-98b3-4f98-837f-a47c163ed5b0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:46.180034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb3631-7a3c-419b-8c9d-7d2df22047f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:46.180661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3631-7a3c-419b-8c9d-7d2df22047f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:46.180965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3631-7a3c-419b-8c9d-7d2df22047f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:46.181250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3631-7a3c-419b-8c9d-7d2df22047f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:46.181896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb3631-7a3c-419b-8c9d-7d2df22047f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:46.183472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb3631-7a3c-419b-8c9d-7d2df22047f9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:46.195784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1024/2031] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:46.199604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda940da-430b-4e77-b30a-11ae437c59bb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:46.212527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda940da-430b-4e77-b30a-11ae437c59bb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:46.219370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864cc92-2b52-490b-8c68-f22505527e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:46.220011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864cc92-2b52-490b-8c68-f22505527e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:46.220288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864cc92-2b52-490b-8c68-f22505527e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:46.220551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864cc92-2b52-490b-8c68-f22505527e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:46.221209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864cc92-2b52-490b-8c68-f22505527e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:46.222871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864cc92-2b52-490b-8c68-f22505527e77 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:46.244925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1008/2032] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:46.247230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb3631-7a3c-419b-8c9d-7d2df22047f9 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:46.261416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb3631-7a3c-419b-8c9d-7d2df22047f9 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:46.267211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:46.268608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:46.268999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:46.269605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] PATH_INFO: `/v3/projects/9fa05c463af24c69ad7bf9a2d5f76a6e/users/df1a5792ffa94afd813c3f0f526890af/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:46.289803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa05c463af24c69ad7bf9a2d5f76a6e, user_id=df1a5792ffa94afd813c3f0f526890af, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:46.292620 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:46.311695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1025/2033] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:46 2022] PUT /identity/v3/projects/9fa05c463af24c69ad7bf9a2d5f76a6e/users/df1a5792ffa94afd813c3f0f526890af/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:46.313768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0155-aca0-4b13-b698-768ea96b0cab None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:46.314165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0155-aca0-4b13-b698-768ea96b0cab None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:46.314462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e0155-aca0-4b13-b698-768ea96b0cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:46.367758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9f5e0155-aca0-4b13-b698-768ea96b0cab None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:46.371301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9f5e0155-aca0-4b13-b698-768ea96b0cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:46.457460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:46.489151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1009/2034] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:46.505523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:46.507796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:46.572660 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb1eee-a2ed-4d32-95ab-43776e9d9207 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:46.578402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:46.579143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:46.579888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:46.580260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:46.614152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:46.617302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:46.640215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1026/2035] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:47.876269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0908e0-3988-4e88-b974-2c0085c1ac9d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:47.876775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0908e0-3988-4e88-b974-2c0085c1ac9d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:47.876892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0908e0-3988-4e88-b974-2c0085c1ac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:47.907484 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6d0908e0-3988-4e88-b974-2c0085c1ac9d None None] MFA Rules not processed for user `df1a5792ffa94afd813c3f0f526890af`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:47.908773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6d0908e0-3988-4e88-b974-2c0085c1ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:47.979368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1010/2036] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:47.991353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:47.993477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:48.068880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fc659-46be-4546-a13d-02b6de2492ef service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:48.073397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564337f-cb01-4279-8482-e84846e4b7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:48.074756 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564337f-cb01-4279-8482-e84846e4b7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:48.075135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564337f-cb01-4279-8482-e84846e4b7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:48.075416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564337f-cb01-4279-8482-e84846e4b7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:48.091444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564337f-cb01-4279-8482-e84846e4b7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:48.092887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564337f-cb01-4279-8482-e84846e4b7b8 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:48.103442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1027/2037] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:48.606391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0908e0-3988-4e88-b974-2c0085c1ac9d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:48.607950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6d0908e0-3988-4e88-b974-2c0085c1ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:48.622539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0908e0-3988-4e88-b974-2c0085c1ac9d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:48.627289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:48.627981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:48.628265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:48.628538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] PATH_INFO: `/v3/users/ef6c0fa09eb94e688705d9b219b874c7` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:48.629697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6c0fa09eb94e688705d9b219b874c7)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:48.631781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:48.685950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6c0fa09eb94e688705d9b219b874c7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:48.700890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6c0fa09eb94e688705d9b219b874c7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:48.712192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6c0fa09eb94e688705d9b219b874c7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:48.722214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6c0fa09eb94e688705d9b219b874c7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:48.722895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6c0fa09eb94e688705d9b219b874c7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:48.729530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1011/2038] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:48 2022] DELETE /identity/v3/users/ef6c0fa09eb94e688705d9b219b874c7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:48.736195 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc31d4-702c-443b-99d8-68b7d486cc1c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:48.736527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc31d4-702c-443b-99d8-68b7d486cc1c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:48.736865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc31d4-702c-443b-99d8-68b7d486cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:48.758343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-00dc31d4-702c-443b-99d8-68b7d486cc1c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:48.759594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-00dc31d4-702c-443b-99d8-68b7d486cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:48.831346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1028/2039] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:48.841416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:48.842954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:48.914459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805d2cb-ccb0-494e-a6e3-981a6b97f002 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:48.918329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577891e-6b41-427a-a34a-b8cb60657b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:48.918950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577891e-6b41-427a-a34a-b8cb60657b72 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:48.919290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577891e-6b41-427a-a34a-b8cb60657b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:48.919841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577891e-6b41-427a-a34a-b8cb60657b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:48.929339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577891e-6b41-427a-a34a-b8cb60657b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:48.930786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577891e-6b41-427a-a34a-b8cb60657b72 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:48.935984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:48.941109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1012/2040] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:49.218788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc31d4-702c-443b-99d8-68b7d486cc1c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:49.220330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-00dc31d4-702c-443b-99d8-68b7d486cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:49.232397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc31d4-702c-443b-99d8-68b7d486cc1c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:49.237727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:49.238733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:49.239179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:49.239549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] PATH_INFO: `/v3/projects/bbe070896b6947ffbc27a22e96d19a13` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:49.240922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe070896b6947ffbc27a22e96d19a13)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:49.243362 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:49.246932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:49.293552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe070896b6947ffbc27a22e96d19a13', 'request_id': 'req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.299375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe070896b6947ffbc27a22e96d19a13', 'request_id': 'req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.306295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe070896b6947ffbc27a22e96d19a13', 'request_id': 'req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.321380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] The token cache is being invalidate because project bbe070896b6947ffbc27a22e96d19a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:49.321781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.322543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b2df14cb-6cdd-4e1b-a37c-43476c38fe9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.324267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1029/2041] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:49 2022] DELETE /identity/v3/projects/bbe070896b6947ffbc27a22e96d19a13 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:49.330761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577891e-6b41-427a-a34a-b8cb60657b72 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:49.341812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577891e-6b41-427a-a34a-b8cb60657b72 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:49.411216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:49.411794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:49.412128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:49.412421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] PATH_INFO: `/v3/users/4c675662bd0a48a1b5f6569692bb62b2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:49.413795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c675662bd0a48a1b5f6569692bb62b2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:49.415710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:49.474601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c675662bd0a48a1b5f6569692bb62b2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.490544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c675662bd0a48a1b5f6569692bb62b2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.499564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c675662bd0a48a1b5f6569692bb62b2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.509654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c675662bd0a48a1b5f6569692bb62b2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.510332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c675662bd0a48a1b5f6569692bb62b2'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:49.517313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1013/2042] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:49 2022] DELETE /identity/v3/users/4c675662bd0a48a1b5f6569692bb62b2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:49.540315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fbd71-863b-4e87-9eb0-80edb13666b8 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:49.540602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fbd71-863b-4e87-9eb0-80edb13666b8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:49.540875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fbd71-863b-4e87-9eb0-80edb13666b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:49.573445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-030fbd71-863b-4e87-9eb0-80edb13666b8 None None] MFA Rules not processed for user `df1a5792ffa94afd813c3f0f526890af`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:49.575786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-030fbd71-863b-4e87-9eb0-80edb13666b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:49.650885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1030/2043] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:49.997934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:49.999939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:50.103081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355c5cd-5e17-4c00-a143-17c946037e4f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:50.109165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:50.110397 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:50.110678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:50.110946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] PATH_INFO: `/v3/projects/fafe628ff3104a2095c5a89812e9be09` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:50.112185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafe628ff3104a2095c5a89812e9be09)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:50.114173 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:50.145211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:50.209924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafe628ff3104a2095c5a89812e9be09', 'request_id': 'req-a54ffcc5-54ce-428e-88f3-fcd45d21243c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.224794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafe628ff3104a2095c5a89812e9be09', 'request_id': 'req-a54ffcc5-54ce-428e-88f3-fcd45d21243c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.233357 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafe628ff3104a2095c5a89812e9be09', 'request_id': 'req-a54ffcc5-54ce-428e-88f3-fcd45d21243c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.251830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] The token cache is being invalidate because project fafe628ff3104a2095c5a89812e9be09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:50.252349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.253595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.255526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1014/2044] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:49 2022] DELETE /identity/v3/projects/fafe628ff3104a2095c5a89812e9be09 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:50.260680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fbd71-863b-4e87-9eb0-80edb13666b8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:50.274942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fbd71-863b-4e87-9eb0-80edb13666b8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:50.384533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:50.385544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:50.386827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:50.387587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] PATH_INFO: `/v3/users/36af8090ed1840d9b2cd7a9ed80695b6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:50.390198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36af8090ed1840d9b2cd7a9ed80695b6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:50.392682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:50.457519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:50.468132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36af8090ed1840d9b2cd7a9ed80695b6'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.469097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36af8090ed1840d9b2cd7a9ed80695b6'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.491565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36af8090ed1840d9b2cd7a9ed80695b6'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.513480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36af8090ed1840d9b2cd7a9ed80695b6'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.526218 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36af8090ed1840d9b2cd7a9ed80695b6'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:50.535850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1031/2045] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:50 2022] DELETE /identity/v3/users/36af8090ed1840d9b2cd7a9ed80695b6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:51.448367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:51.450390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:51.464982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ffcc5-54ce-428e-88f3-fcd45d21243c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:51.531607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:51.533297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:51.556559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:51.556990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:51.557308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:51.557583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] PATH_INFO: `/v3/users/4fa3654358d94e05aa0486b905d5407d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:51.558736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa3654358d94e05aa0486b905d5407d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:51.560685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:51.629132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa3654358d94e05aa0486b905d5407d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.644445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa3654358d94e05aa0486b905d5407d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.644913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077d29b-1a95-4292-88d9-bce5594f8688 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:51.650962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:51.651683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:51.651971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:51.652243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] PATH_INFO: `/v3/projects/a0400357995f4d848f4ae63d09e28369` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:51.653486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0400357995f4d848f4ae63d09e28369)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:51.653847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa3654358d94e05aa0486b905d5407d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.655500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:51.663384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa3654358d94e05aa0486b905d5407d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.664243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c179c8ce-79e4-4601-b564-52f61e37e4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa3654358d94e05aa0486b905d5407d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.671159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1015/2046] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:51 2022] DELETE /identity/v3/users/4fa3654358d94e05aa0486b905d5407d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:51.675900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd93d-468b-4e6a-930d-377710d0f7f1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:51.676602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd93d-468b-4e6a-930d-377710d0f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:51.676962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd93d-468b-4e6a-930d-377710d0f7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:51.698585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-997cd93d-468b-4e6a-930d-377710d0f7f1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:51.699941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-997cd93d-468b-4e6a-930d-377710d0f7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:51.711175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0400357995f4d848f4ae63d09e28369', 'request_id': 'req-7da8667d-4b46-4877-b8d0-0e6463ef4650'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.718410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0400357995f4d848f4ae63d09e28369', 'request_id': 'req-7da8667d-4b46-4877-b8d0-0e6463ef4650'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.727092 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:51.744104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0400357995f4d848f4ae63d09e28369', 'request_id': 'req-7da8667d-4b46-4877-b8d0-0e6463ef4650'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.767757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] The token cache is being invalidate because project a0400357995f4d848f4ae63d09e28369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:51.768311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.769681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:51.771892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1016/2047] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:51.772794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1032/2048] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:51 2022] DELETE /identity/v3/projects/a0400357995f4d848f4ae63d09e28369 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:51.778336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef90d-fbf2-4d6c-941b-0fe61137711e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:51.778808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef90d-fbf2-4d6c-941b-0fe61137711e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:51.779270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ef90d-fbf2-4d6c-941b-0fe61137711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:51.786251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:51.787825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:51.802661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0c3ef90d-fbf2-4d6c-941b-0fe61137711e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:51.804230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0c3ef90d-fbf2-4d6c-941b-0fe61137711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:51.817163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1017/2049] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:51.821947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe487c-878b-4bfc-a021-22a9e6736acd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:51.822228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe487c-878b-4bfc-a021-22a9e6736acd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:51.822572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe487c-878b-4bfc-a021-22a9e6736acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:51.843964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0dfe487c-878b-4bfc-a021-22a9e6736acd None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:51.846296 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0dfe487c-878b-4bfc-a021-22a9e6736acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:51.854238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1018/2050] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:51.858970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe487c-878b-4bfc-a021-22a9e6736acd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:51.868173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:51.872663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe487c-878b-4bfc-a021-22a9e6736acd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:51.878214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:51.879078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:51.879554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:51.879758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:51.880413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:51.880712 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:51.881355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8667d-4b46-4877-b8d0-0e6463ef4650 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:51.882662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:51.887175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:51.888019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:51.888575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:51.888982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:51.891185 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:51.899691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1019/2051] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:51.904338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:51.907812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:51.918406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:51.936909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1033/2052] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:51.945778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eac1f3-ad5b-466d-9632-9b8928d5c9de admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:51.962736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae56dfe-4179-4a73-9c0d-b091a64354a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:51.964258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae56dfe-4179-4a73-9c0d-b091a64354a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:51.964665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae56dfe-4179-4a73-9c0d-b091a64354a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:51.965106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae56dfe-4179-4a73-9c0d-b091a64354a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:51.967039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae56dfe-4179-4a73-9c0d-b091a64354a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:51.970827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae56dfe-4179-4a73-9c0d-b091a64354a1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.013260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1020/2053] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:51 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:52.015156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:52.044154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ec12b-fb8d-4c6b-9817-a631391ae31e service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:52.167805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019c15f-8367-444f-af4f-3827156492f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:52.168528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c15f-8367-444f-af4f-3827156492f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.168874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c15f-8367-444f-af4f-3827156492f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.169234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019c15f-8367-444f-af4f-3827156492f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.169943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019c15f-8367-444f-af4f-3827156492f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:52.171894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019c15f-8367-444f-af4f-3827156492f6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.231803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1034/2054] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:52 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:52.232799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae56dfe-4179-4a73-9c0d-b091a64354a1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:52.245797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae56dfe-4179-4a73-9c0d-b091a64354a1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:52.260489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737577e-d8b8-4049-8eaf-a678c8120bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:52.261281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737577e-d8b8-4049-8eaf-a678c8120bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.261801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737577e-d8b8-4049-8eaf-a678c8120bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.262185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737577e-d8b8-4049-8eaf-a678c8120bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.262966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737577e-d8b8-4049-8eaf-a678c8120bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:52.270140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737577e-d8b8-4049-8eaf-a678c8120bf5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.304403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1021/2055] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:52.308267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019c15f-8367-444f-af4f-3827156492f6 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:52.321488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019c15f-8367-444f-af4f-3827156492f6 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:52.331387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5d3c-c02d-459e-9e18-8ec4635d77ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:52.332938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5d3c-c02d-459e-9e18-8ec4635d77ea admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.334170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5d3c-c02d-459e-9e18-8ec4635d77ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.334618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5d3c-c02d-459e-9e18-8ec4635d77ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.335831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb5d3c-c02d-459e-9e18-8ec4635d77ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:52.338030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb5d3c-c02d-459e-9e18-8ec4635d77ea admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.354383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1035/2056] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:52.358657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737577e-d8b8-4049-8eaf-a678c8120bf5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:52.375301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737577e-d8b8-4049-8eaf-a678c8120bf5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:52.382687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:52.383526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.383841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.384244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] PATH_INFO: `/v3/projects/e8a0c5c9e1134a0ea82f1ac830f55dcf/users/1ce57a9ea7d543758cee548b46c48d61/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.402962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a0c5c9e1134a0ea82f1ac830f55dcf, user_id=1ce57a9ea7d543758cee548b46c48d61, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:52.407283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.422497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1022/2057] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:52 2022] PUT /identity/v3/projects/e8a0c5c9e1134a0ea82f1ac830f55dcf/users/1ce57a9ea7d543758cee548b46c48d61/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:52.438699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbe6e6-c9b7-443d-b6a1-f26ce60bb82f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.438970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbe6e6-c9b7-443d-b6a1-f26ce60bb82f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.439244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbe6e6-c9b7-443d-b6a1-f26ce60bb82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.460043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:52.477122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:52.534733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-cdcbe6e6-c9b7-443d-b6a1-f26ce60bb82f None None] MFA Rules not processed for user `1ce57a9ea7d543758cee548b46c48d61`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:52.536809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-cdcbe6e6-c9b7-443d-b6a1-f26ce60bb82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:52.578304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfaa24-05ba-4c51-a7be-9edb108bb3cb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:52.590166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:52.590834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.591116 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.591392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] PATH_INFO: `/v3/projects/cfda5e86bd3944a48eade2410e6871a1` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.594718 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfda5e86bd3944a48eade2410e6871a1)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:52.596816 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.636614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1036/2058] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:52.641367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbe6e6-c9b7-443d-b6a1-f26ce60bb82f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:52.654643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbe6e6-c9b7-443d-b6a1-f26ce60bb82f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:52.672069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:52.674758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfda5e86bd3944a48eade2410e6871a1', 'request_id': 'req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:52.689464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfda5e86bd3944a48eade2410e6871a1', 'request_id': 'req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:52.699739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfda5e86bd3944a48eade2410e6871a1', 'request_id': 'req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:52.721999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] The token cache is being invalidate because project cfda5e86bd3944a48eade2410e6871a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:52.722915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:52.724034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a6068f8e-23a2-4c81-8169-6dd396f3f3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:52.728700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1023/2059] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:52 2022] DELETE /identity/v3/projects/cfda5e86bd3944a48eade2410e6871a1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:52.733507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71392-44ae-48c4-b8a7-b88b5268040b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.733862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71392-44ae-48c4-b8a7-b88b5268040b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.734202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71392-44ae-48c4-b8a7-b88b5268040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.751554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:52.760120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:52.760845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.762067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.762394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.763234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:52.765277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.769739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-43b71392-44ae-48c4-b8a7-b88b5268040b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:52.772352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-43b71392-44ae-48c4-b8a7-b88b5268040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:52.784312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1024/2060] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:52.792334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eff8b8-898d-47fb-abdf-71fb10b4d5b5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.792741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eff8b8-898d-47fb-abdf-71fb10b4d5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.793209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eff8b8-898d-47fb-abdf-71fb10b4d5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.806387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1037/2061] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:52 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:52.810254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:52.814608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:52.823943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-70eff8b8-898d-47fb-abdf-71fb10b4d5b5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:52.825718 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-70eff8b8-898d-47fb-abdf-71fb10b4d5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:52.929049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6d5b8-384d-41a1-9a35-3cc2c73895ea admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:52.941945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1025/2062] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:52.945121 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6d406-fd10-474c-9710-30f1a5365b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:52.945744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eff8b8-898d-47fb-abdf-71fb10b4d5b5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:52.945859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6d406-fd10-474c-9710-30f1a5365b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.946047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6d406-fd10-474c-9710-30f1a5365b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.946392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6d406-fd10-474c-9710-30f1a5365b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.946972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6d406-fd10-474c-9710-30f1a5365b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:52.948912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6d406-fd10-474c-9710-30f1a5365b87 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.968578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eff8b8-898d-47fb-abdf-71fb10b4d5b5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:52.974945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:52.976156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:52.976444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:52.976786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:52.977657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:52.977962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:52.980274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:52.993140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1038/2063] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:52 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:52.995169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6d406-fd10-474c-9710-30f1a5365b87 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.010858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1026/2064] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:53.012175 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.014405 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6d406-fd10-474c-9710-30f1a5365b87 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.026530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e263-3e53-436c-a7e5-59a06d429042 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.028437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6f105-6017-46b1-98c0-4357e49257a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.030607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6f105-6017-46b1-98c0-4357e49257a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.031258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6f105-6017-46b1-98c0-4357e49257a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.032024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6f105-6017-46b1-98c0-4357e49257a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.033303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef4df9-97f3-440a-86b9-e5bcbb98abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.033683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6f105-6017-46b1-98c0-4357e49257a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.033992 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4df9-97f3-440a-86b9-e5bcbb98abac admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.034496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4df9-97f3-440a-86b9-e5bcbb98abac admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.034849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef4df9-97f3-440a-86b9-e5bcbb98abac admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.036346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef4df9-97f3-440a-86b9-e5bcbb98abac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.036471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6f105-6017-46b1-98c0-4357e49257a5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.038186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef4df9-97f3-440a-86b9-e5bcbb98abac admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.059230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1039/2065] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:19:53.060912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6f105-6017-46b1-98c0-4357e49257a5 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.076307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6f105-6017-46b1-98c0-4357e49257a5 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.082311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd307f7b-16ef-4e84-828f-80d091ba485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.083092 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307f7b-16ef-4e84-828f-80d091ba485d admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.083237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1027/2066] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:53 2022] POST /identity/v3/projects => generated 359 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:53.083499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307f7b-16ef-4e84-828f-80d091ba485d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.084033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307f7b-16ef-4e84-828f-80d091ba485d admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.084414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef4df9-97f3-440a-86b9-e5bcbb98abac admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.085407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd307f7b-16ef-4e84-828f-80d091ba485d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.087393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd307f7b-16ef-4e84-828f-80d091ba485d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.106621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1040/2067] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:53.107815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd307f7b-16ef-4e84-828f-80d091ba485d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.123171 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd307f7b-16ef-4e84-828f-80d091ba485d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.166141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef4df9-97f3-440a-86b9-e5bcbb98abac admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.171722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3aae-6124-4ff9-a599-18ec6e576780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.172463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3aae-6124-4ff9-a599-18ec6e576780 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.172833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3aae-6124-4ff9-a599-18ec6e576780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.173250 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa3aae-6124-4ff9-a599-18ec6e576780 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.173982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa3aae-6124-4ff9-a599-18ec6e576780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.176939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa3aae-6124-4ff9-a599-18ec6e576780 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.212436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1028/2068] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:53 2022] POST /identity/v3/users => generated 280 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:53.216990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3aae-6124-4ff9-a599-18ec6e576780 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.240681 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa3aae-6124-4ff9-a599-18ec6e576780 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.250224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463601-5677-42ce-b580-376a14f1ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.251033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463601-5677-42ce-b580-376a14f1ddcb admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.251401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463601-5677-42ce-b580-376a14f1ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.251915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463601-5677-42ce-b580-376a14f1ddcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.253178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa463601-5677-42ce-b580-376a14f1ddcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.255115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa463601-5677-42ce-b580-376a14f1ddcb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.261730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d33b49-4095-4952-a54f-e6158e9af75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.263095 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d33b49-4095-4952-a54f-e6158e9af75c admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.263374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d33b49-4095-4952-a54f-e6158e9af75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.263647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d33b49-4095-4952-a54f-e6158e9af75c admin admin] PATH_INFO: `/v3/projects/80639cdc8c68421aaafd8bc1e57f2cc8/users/71fa03f4e81e4f4d86c0660eca680202/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.273416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1029/2069] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:53.275032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463601-5677-42ce-b580-376a14f1ddcb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.282420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d33b49-4095-4952-a54f-e6158e9af75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80639cdc8c68421aaafd8bc1e57f2cc8, user_id=71fa03f4e81e4f4d86c0660eca680202, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.285200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d33b49-4095-4952-a54f-e6158e9af75c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.289495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463601-5677-42ce-b580-376a14f1ddcb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.303364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1041/2070] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:53 2022] PUT /identity/v3/projects/80639cdc8c68421aaafd8bc1e57f2cc8/users/71fa03f4e81e4f4d86c0660eca680202/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:53.311087 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83313776-a6f9-495e-ad85-21a59e553989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.312004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83313776-a6f9-495e-ad85-21a59e553989 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.312511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83313776-a6f9-495e-ad85-21a59e553989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.313050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83313776-a6f9-495e-ad85-21a59e553989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.315566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3ac2-a71e-4157-b195-5752502f49d6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.315854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3ac2-a71e-4157-b195-5752502f49d6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.316223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3ac2-a71e-4157-b195-5752502f49d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.325921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83313776-a6f9-495e-ad85-21a59e553989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.327587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83313776-a6f9-495e-ad85-21a59e553989 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.351081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-b3ac3ac2-a71e-4157-b195-5752502f49d6 None None] MFA Rules not processed for user `71fa03f4e81e4f4d86c0660eca680202`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:53.352309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b3ac3ac2-a71e-4157-b195-5752502f49d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:53.357790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1030/2071] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:53.361651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83313776-a6f9-495e-ad85-21a59e553989 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.374781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:53.389695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83313776-a6f9-495e-ad85-21a59e553989 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.425270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:53.546522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1042/2072] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:53.549967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac3ac2-a71e-4157-b195-5752502f49d6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.555710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fd91d-07f7-4b03-9032-fe2526337ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.556978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd91d-07f7-4b03-9032-fe2526337ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.557432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd91d-07f7-4b03-9032-fe2526337ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.557885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd91d-07f7-4b03-9032-fe2526337ce8 admin admin] PATH_INFO: `/v3/projects/4e469c418b344a589138ba85b757ad16/users/6ff633c9fecf466d8252095f4e1fc2c0/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.577407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac3ac2-a71e-4157-b195-5752502f49d6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.590397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74869f57-179b-49b0-93b1-a20ccdfc9c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.591032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74869f57-179b-49b0-93b1-a20ccdfc9c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.594129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74869f57-179b-49b0-93b1-a20ccdfc9c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.594364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74869f57-179b-49b0-93b1-a20ccdfc9c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.595057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74869f57-179b-49b0-93b1-a20ccdfc9c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.602594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74869f57-179b-49b0-93b1-a20ccdfc9c92 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.607107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fd91d-07f7-4b03-9032-fe2526337ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e469c418b344a589138ba85b757ad16, user_id=6ff633c9fecf466d8252095f4e1fc2c0, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.610493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fd91d-07f7-4b03-9032-fe2526337ce8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.641722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1031/2073] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:53 2022] PUT /identity/v3/projects/4e469c418b344a589138ba85b757ad16/users/6ff633c9fecf466d8252095f4e1fc2c0/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:53.653478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3905a58-03ab-4972-9470-70fe10b20630 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.653827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3905a58-03ab-4972-9470-70fe10b20630 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.654032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3905a58-03ab-4972-9470-70fe10b20630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.700230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1043/2074] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:53 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:53.706003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74869f57-179b-49b0-93b1-a20ccdfc9c92 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.713965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d3905a58-03ab-4972-9470-70fe10b20630 None None] MFA Rules not processed for user `6ff633c9fecf466d8252095f4e1fc2c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:53.715302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d3905a58-03ab-4972-9470-70fe10b20630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:53.835454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74869f57-179b-49b0-93b1-a20ccdfc9c92 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.857056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1032/2075] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:53.860979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712950a-7ff3-4743-9266-0f4ecdaa2398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.870606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712950a-7ff3-4743-9266-0f4ecdaa2398 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.871419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712950a-7ff3-4743-9266-0f4ecdaa2398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.871419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712950a-7ff3-4743-9266-0f4ecdaa2398 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.872339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712950a-7ff3-4743-9266-0f4ecdaa2398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.874900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712950a-7ff3-4743-9266-0f4ecdaa2398 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.889390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3905a58-03ab-4972-9470-70fe10b20630 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.891308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d3905a58-03ab-4972-9470-70fe10b20630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:53.916449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1044/2076] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:53 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:53.918523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712950a-7ff3-4743-9266-0f4ecdaa2398 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:53.943335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712950a-7ff3-4743-9266-0f4ecdaa2398 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:53.951116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67707-0dee-42a1-8b71-00e7bb699d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:53.951803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67707-0dee-42a1-8b71-00e7bb699d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:53.952084 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67707-0dee-42a1-8b71-00e7bb699d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:53.952349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a67707-0dee-42a1-8b71-00e7bb699d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:53.953493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67707-0dee-42a1-8b71-00e7bb699d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:53.955272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a67707-0dee-42a1-8b71-00e7bb699d5a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:53.989291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1045/2077] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:53.990516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67707-0dee-42a1-8b71-00e7bb699d5a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:54.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3905a58-03ab-4972-9470-70fe10b20630 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:54.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aea5d5-499f-410d-a002-8fcf2efb5cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:54.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aea5d5-499f-410d-a002-8fcf2efb5cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.001603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aea5d5-499f-410d-a002-8fcf2efb5cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.006121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aea5d5-499f-410d-a002-8fcf2efb5cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.009963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aea5d5-499f-410d-a002-8fcf2efb5cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:54.010456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a67707-0dee-42a1-8b71-00e7bb699d5a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:54.011407 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aea5d5-499f-410d-a002-8fcf2efb5cc3 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:54.016800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df46fe-0fb3-4a42-98cf-889bffa7af4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:54.017753 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df46fe-0fb3-4a42-98cf-889bffa7af4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.018152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df46fe-0fb3-4a42-98cf-889bffa7af4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.018532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df46fe-0fb3-4a42-98cf-889bffa7af4f admin admin] PATH_INFO: `/v3/projects/05db7aba56a54990b54a106e7a22c9dc/users/2a81b4a338794d28861f31e25e085066/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.022438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1033/2078] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:54.040511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aea5d5-499f-410d-a002-8fcf2efb5cc3 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:54.044759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df46fe-0fb3-4a42-98cf-889bffa7af4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05db7aba56a54990b54a106e7a22c9dc, user_id=2a81b4a338794d28861f31e25e085066, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:54.047853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df46fe-0fb3-4a42-98cf-889bffa7af4f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:54.051710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aea5d5-499f-410d-a002-8fcf2efb5cc3 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:54.057207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:54.059676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.059974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.060243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] PATH_INFO: `/v3/users/6ff633c9fecf466d8252095f4e1fc2c0` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.062124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff633c9fecf466d8252095f4e1fc2c0)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:54.064049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:54.074339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1046/2079] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:53 2022] PUT /identity/v3/projects/05db7aba56a54990b54a106e7a22c9dc/users/2a81b4a338794d28861f31e25e085066/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:54.076297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df46fe-0fb3-4a42-98cf-889bffa7af4f admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:54.085362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:54.140393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff633c9fecf466d8252095f4e1fc2c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:54.157074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff633c9fecf466d8252095f4e1fc2c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:54.166693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:54.168522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff633c9fecf466d8252095f4e1fc2c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:54.174629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df46fe-0fb3-4a42-98cf-889bffa7af4f admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:54.180850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff633c9fecf466d8252095f4e1fc2c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:54.182266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca2bbb8d-b2a7-4c11-b936-92e866dae7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff633c9fecf466d8252095f4e1fc2c0'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:54.183238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:54.184126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.184974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.186094 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.187118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:54.189557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:54.192042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1034/2080] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:54 2022] DELETE /identity/v3/users/6ff633c9fecf466d8252095f4e1fc2c0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:54.198815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8aeaa-3276-44e6-8a60-2b9111416c65 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.199184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8aeaa-3276-44e6-8a60-2b9111416c65 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.199586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8aeaa-3276-44e6-8a60-2b9111416c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.204230 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1047/2081] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:19:54.208776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:54.211655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:54.241938 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396436-1446-4f7e-9b9e-21c7ce7d7a43 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:54.243853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9da8aeaa-3276-44e6-8a60-2b9111416c65 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:54.245182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9da8aeaa-3276-44e6-8a60-2b9111416c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:54.355916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb13d3-11fd-4746-b44d-f5c8a117bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:54.356605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb13d3-11fd-4746-b44d-f5c8a117bdf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.356972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb13d3-11fd-4746-b44d-f5c8a117bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.357249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb13d3-11fd-4746-b44d-f5c8a117bdf6 admin admin] PATH_INFO: `/v3/projects/05db7aba56a54990b54a106e7a22c9dc/users/2a81b4a338794d28861f31e25e085066/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.360573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb13d3-11fd-4746-b44d-f5c8a117bdf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05db7aba56a54990b54a106e7a22c9dc, user_id=2a81b4a338794d28861f31e25e085066, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:54.366272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb13d3-11fd-4746-b44d-f5c8a117bdf6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:54.380376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1035/2082] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:54.390463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1048/2083] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:54 2022] PUT /identity/v3/projects/05db7aba56a54990b54a106e7a22c9dc/users/2a81b4a338794d28861f31e25e085066/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:19:54.402346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8aeaa-3276-44e6-8a60-2b9111416c65 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:54.402643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bffea-1a45-415d-91c9-21894e59b5fa None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.403232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bffea-1a45-415d-91c9-21894e59b5fa None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.403609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bffea-1a45-415d-91c9-21894e59b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.407651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9da8aeaa-3276-44e6-8a60-2b9111416c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:54.466942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d58bffea-1a45-415d-91c9-21894e59b5fa None None] MFA Rules not processed for user `2a81b4a338794d28861f31e25e085066`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:54.468866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d58bffea-1a45-415d-91c9-21894e59b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:54.514462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8aeaa-3276-44e6-8a60-2b9111416c65 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:54.578482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1049/2084] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:54.590195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:54.592588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bffea-1a45-415d-91c9-21894e59b5fa None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:54.595560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d58bffea-1a45-415d-91c9-21894e59b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:54.597639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:54.598776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.599117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.599453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.685351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bffea-1a45-415d-91c9-21894e59b5fa None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:54.692146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07996b9e-c14d-4ea6-b4b3-0bc8cd7c5fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:54.692925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07996b9e-c14d-4ea6-b4b3-0bc8cd7c5fcf service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:54.693325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07996b9e-c14d-4ea6-b4b3-0bc8cd7c5fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:54.693687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07996b9e-c14d-4ea6-b4b3-0bc8cd7c5fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:54.695047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:54.696947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:54.697074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-07996b9e-c14d-4ea6-b4b3-0bc8cd7c5fcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:54.710081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1036/2085] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:54.738949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:54.817263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07996b9e-c14d-4ea6-b4b3-0bc8cd7c5fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:54.825670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07996b9e-c14d-4ea6-b4b3-0bc8cd7c5fcf service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:54.872351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1050/2086] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:55.766156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:55.767817 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:55.784821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9ff62-c9c0-4e00-91c3-3cf45a061f32 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:55.790390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:55.791053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:55.791462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:55.791739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] PATH_INFO: `/v3/projects/4e469c418b344a589138ba85b757ad16` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:55.793058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e469c418b344a589138ba85b757ad16)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:55.795057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:55.851844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e469c418b344a589138ba85b757ad16', 'request_id': 'req-f306e8c9-04fb-4f22-8283-430867ecd3ba'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:55.860252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e469c418b344a589138ba85b757ad16', 'request_id': 'req-f306e8c9-04fb-4f22-8283-430867ecd3ba'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:55.868610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e469c418b344a589138ba85b757ad16', 'request_id': 'req-f306e8c9-04fb-4f22-8283-430867ecd3ba'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:55.880379 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] The token cache is being invalidate because project 4e469c418b344a589138ba85b757ad16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:55.880685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:55.881416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f306e8c9-04fb-4f22-8283-430867ecd3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:55.883474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1037/2087] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:55 2022] DELETE /identity/v3/projects/4e469c418b344a589138ba85b757ad16 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:55.888467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ca07-e5ac-4df7-a9a7-76e2dc7ad6b0 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:55.889339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ca07-e5ac-4df7-a9a7-76e2dc7ad6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:55.889619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ca07-e5ac-4df7-a9a7-76e2dc7ad6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:55.911595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-1f28ca07-e5ac-4df7-a9a7-76e2dc7ad6b0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:55.912902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1f28ca07-e5ac-4df7-a9a7-76e2dc7ad6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:55.989279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1051/2088] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:55.998358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7849e-c538-4c11-8e69-1e9f4dc760bf None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:55.998621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7849e-c538-4c11-8e69-1e9f4dc760bf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:55.998818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7849e-c538-4c11-8e69-1e9f4dc760bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.022241 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-51c7849e-c538-4c11-8e69-1e9f4dc760bf None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:56.023764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-51c7849e-c538-4c11-8e69-1e9f4dc760bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.034985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1038/2089] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:56.040260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ca07-e5ac-4df7-a9a7-76e2dc7ad6b0 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.052325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ca07-e5ac-4df7-a9a7-76e2dc7ad6b0 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.059842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add388e-43ed-478b-b907-f4f9a16d8e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.060674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add388e-43ed-478b-b907-f4f9a16d8e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.061479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add388e-43ed-478b-b907-f4f9a16d8e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.061759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add388e-43ed-478b-b907-f4f9a16d8e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.062425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add388e-43ed-478b-b907-f4f9a16d8e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:56.062709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add388e-43ed-478b-b907-f4f9a16d8e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.064501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add388e-43ed-478b-b907-f4f9a16d8e32 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.082661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1052/2090] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:56.086874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7849e-c538-4c11-8e69-1e9f4dc760bf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.108165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7849e-c538-4c11-8e69-1e9f4dc760bf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.114444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adc4f0-5cde-400d-abcb-162d0bfb7bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.115342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc4f0-5cde-400d-abcb-162d0bfb7bef admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.116455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc4f0-5cde-400d-abcb-162d0bfb7bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.116974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc4f0-5cde-400d-abcb-162d0bfb7bef admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.117901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adc4f0-5cde-400d-abcb-162d0bfb7bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.119064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc702-44c5-42c5-be37-cd056b40e046 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.119357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc702-44c5-42c5-be37-cd056b40e046 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.119626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc702-44c5-42c5-be37-cd056b40e046 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.120609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adc4f0-5cde-400d-abcb-162d0bfb7bef admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.121149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1053/2091] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:19:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:19:56.149758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95eb50-df99-4074-b06b-1e0595f68a1c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.150038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95eb50-df99-4074-b06b-1e0595f68a1c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.150849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95eb50-df99-4074-b06b-1e0595f68a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.154896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1039/2092] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:56 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:56.155775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adc4f0-5cde-400d-abcb-162d0bfb7bef admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.174163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-2b95eb50-df99-4074-b06b-1e0595f68a1c None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:56.176056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2b95eb50-df99-4074-b06b-1e0595f68a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.228834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:56.254317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adc4f0-5cde-400d-abcb-162d0bfb7bef admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.261113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.261743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.262445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.262721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.263653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.266983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.279774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1054/2093] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:19:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:56.280637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95eb50-df99-4074-b06b-1e0595f68a1c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.281978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2b95eb50-df99-4074-b06b-1e0595f68a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.293335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1040/2094] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:56 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:56.294186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.297910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.298541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95eb50-df99-4074-b06b-1e0595f68a1c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.304067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.304919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.305231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.306238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] PATH_INFO: `/v3/users/b18cbec44ebd4bd38a352b5ebeb61a68` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.307804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18cbec44ebd4bd38a352b5ebeb61a68)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.310091 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.317635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bd879-999b-4a9d-b24c-34299371f095 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.324898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb383-c5ac-4730-85bb-11e64209f1c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.325645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb383-c5ac-4730-85bb-11e64209f1c4 service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.325928 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb383-c5ac-4730-85bb-11e64209f1c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.326201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb383-c5ac-4730-85bb-11e64209f1c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.335262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecb383-c5ac-4730-85bb-11e64209f1c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.337104 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecb383-c5ac-4730-85bb-11e64209f1c4 service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.348662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1041/2095] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:56.349626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb383-c5ac-4730-85bb-11e64209f1c4 service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.361133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb383-c5ac-4730-85bb-11e64209f1c4 service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.368354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d5f6b-2c1d-449d-a05d-ddb634814a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.369398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5f6b-2c1d-449d-a05d-ddb634814a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.369794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5f6b-2c1d-449d-a05d-ddb634814a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.370200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d5f6b-2c1d-449d-a05d-ddb634814a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.371265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d5f6b-2c1d-449d-a05d-ddb634814a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.372617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d5f6b-2c1d-449d-a05d-ddb634814a20 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.385252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1042/2096] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:56.388228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:56.389774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d5f6b-2c1d-449d-a05d-ddb634814a20 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.403617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d5f6b-2c1d-449d-a05d-ddb634814a20 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.406489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18cbec44ebd4bd38a352b5ebeb61a68'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:56.408896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18cbec44ebd4bd38a352b5ebeb61a68'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:56.410258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.411140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.411416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.411756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.412633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.414500 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.438359 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18cbec44ebd4bd38a352b5ebeb61a68'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:56.451602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1043/2097] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:56.452738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.454849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.464273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18cbec44ebd4bd38a352b5ebeb61a68'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:56.471255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba894d-8964-4a68-89ac-cc90728b3224 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.480063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.481615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.482566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.483293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] PATH_INFO: `/v3/projects/ec895f51df2b4072b9d23c40c457271b/users/949470c3e3eb4d72b003760b6c16302b/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.495067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-20b7e17b-3c58-4a62-9af2-a83bc4c723ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18cbec44ebd4bd38a352b5ebeb61a68'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:56.512891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1055/2098] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:19:56 2022] DELETE /identity/v3/users/b18cbec44ebd4bd38a352b5ebeb61a68 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:56.514304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec895f51df2b4072b9d23c40c457271b, user_id=949470c3e3eb4d72b003760b6c16302b, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.521276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.557175 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1044/2099] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:56 2022] PUT /identity/v3/projects/ec895f51df2b4072b9d23c40c457271b/users/949470c3e3eb4d72b003760b6c16302b/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:56.568021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1d913-2e4a-4679-9152-f3c31d9864bd None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.568560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1d913-2e4a-4679-9152-f3c31d9864bd None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.568976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1d913-2e4a-4679-9152-f3c31d9864bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.619413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-dec1d913-2e4a-4679-9152-f3c31d9864bd None None] MFA Rules not processed for user `949470c3e3eb4d72b003760b6c16302b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:56.620908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-dec1d913-2e4a-4679-9152-f3c31d9864bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.749763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1056/2100] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:56.762675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.765360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.837888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1d913-2e4a-4679-9152-f3c31d9864bd None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:56.838879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f67e70-910c-4a36-b177-78ddfd40bec6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.839424 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-dec1d913-2e4a-4679-9152-f3c31d9864bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.842618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.843323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.843654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.844007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.854462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.855377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1d913-2e4a-4679-9152-f3c31d9864bd None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:56.855922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.859456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdd4f3-2357-4af6-823f-25fa8a76b4ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:56.860087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd4f3-2357-4af6-823f-25fa8a76b4ad service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:56.860600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd4f3-2357-4af6-823f-25fa8a76b4ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:56.860892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd4f3-2357-4af6-823f-25fa8a76b4ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:56.863458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-05cdd4f3-2357-4af6-823f-25fa8a76b4ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:56.867029 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1045/2101] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:56.937001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdd4f3-2357-4af6-823f-25fa8a76b4ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:56.938813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdd4f3-2357-4af6-823f-25fa8a76b4ad service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:56.950022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1057/2102] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:19:57.075969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:57.078164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:57.183772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f349b-48a5-4d54-9425-4fa416662ecd service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:57.189913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:57.190702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.191018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.191396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] PATH_INFO: `/v3/projects/e4d5c33eaa1e45618df214595397348a` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.192549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d5c33eaa1e45618df214595397348a)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:57.195701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:57.279814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:57.315243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d5c33eaa1e45618df214595397348a', 'request_id': 'req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:57.332249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d5c33eaa1e45618df214595397348a', 'request_id': 'req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:57.344780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d5c33eaa1e45618df214595397348a', 'request_id': 'req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:57.365155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] The token cache is being invalidate because project e4d5c33eaa1e45618df214595397348a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:19:57.365564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:57.367706 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-12af1bd0-5636-4da4-9d6b-b44b04eeb02b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:19:57.369812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1046/2103] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:19:57 2022] DELETE /identity/v3/projects/e4d5c33eaa1e45618df214595397348a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:57.383433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb09c8-12ed-4c24-92aa-503a12c69ec9 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.383727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb09c8-12ed-4c24-92aa-503a12c69ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.384062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb09c8-12ed-4c24-92aa-503a12c69ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.410100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-50fb09c8-12ed-4c24-92aa-503a12c69ec9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:57.411353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-50fb09c8-12ed-4c24-92aa-503a12c69ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:57.456429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:57.473935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1058/2104] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:57.483374 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4432f4c-5c74-4940-837d-4f8ac93dcd2b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.483658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4432f4c-5c74-4940-837d-4f8ac93dcd2b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.483931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4432f4c-5c74-4940-837d-4f8ac93dcd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.508037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b4432f4c-5c74-4940-837d-4f8ac93dcd2b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:57.509883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b4432f4c-5c74-4940-837d-4f8ac93dcd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:57.524238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1047/2105] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:57.528979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb09c8-12ed-4c24-92aa-503a12c69ec9 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:57.540129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb09c8-12ed-4c24-92aa-503a12c69ec9 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:57.546715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:57.547436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.548273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.548273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.549113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:19:57.549591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:57.551097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:57.567473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1059/2106] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:19:57.571184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4432f4c-5c74-4940-837d-4f8ac93dcd2b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:57.582293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4432f4c-5c74-4940-837d-4f8ac93dcd2b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:57.588024 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09561d-7110-41a0-a64f-401e13781d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:57.588741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09561d-7110-41a0-a64f-401e13781d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.589047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09561d-7110-41a0-a64f-401e13781d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.589360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09561d-7110-41a0-a64f-401e13781d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.590089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09561d-7110-41a0-a64f-401e13781d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:57.592988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09561d-7110-41a0-a64f-401e13781d3a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:57.625280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1048/2107] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:57 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:57.628517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:57.640937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6654518-ce7f-46a1-a509-64512061e2c2 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:57.711074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc715b7-6a7c-4906-8a4e-162641b5cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:57.711799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc715b7-6a7c-4906-8a4e-162641b5cf37 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.712149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc715b7-6a7c-4906-8a4e-162641b5cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.712488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc715b7-6a7c-4906-8a4e-162641b5cf37 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.713270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc715b7-6a7c-4906-8a4e-162641b5cf37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:57.715222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc715b7-6a7c-4906-8a4e-162641b5cf37 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:57.745242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1060/2108] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:57 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:19:57.747042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09561d-7110-41a0-a64f-401e13781d3a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:57.759699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09561d-7110-41a0-a64f-401e13781d3a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:57.764623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:57.765370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.765731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.766084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.766805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:57.768559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:57.783046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1049/2109] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:57.784984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc715b7-6a7c-4906-8a4e-162641b5cf37 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:57.802710 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc715b7-6a7c-4906-8a4e-162641b5cf37 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:57.803994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:57.805733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:57.811279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac0a57-6a96-478a-8537-07ed3cc53c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:57.812023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac0a57-6a96-478a-8537-07ed3cc53c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.812446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac0a57-6a96-478a-8537-07ed3cc53c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.812807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac0a57-6a96-478a-8537-07ed3cc53c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.813737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac0a57-6a96-478a-8537-07ed3cc53c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:57.815765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac0a57-6a96-478a-8537-07ed3cc53c66 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:57.834902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1061/2110] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:57.836125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac0a57-6a96-478a-8537-07ed3cc53c66 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:57.848398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac0a57-6a96-478a-8537-07ed3cc53c66 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:57.853397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11895967-66bd-42ef-a2e5-76fa6155a489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:57.854065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895967-66bd-42ef-a2e5-76fa6155a489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.854920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895967-66bd-42ef-a2e5-76fa6155a489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.857227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11895967-66bd-42ef-a2e5-76fa6155a489 admin admin] PATH_INFO: `/v3/projects/80764bdc777d4da88bd81c5cfc69dd9f/users/47f29c2aa041417091a206a989bac8e9/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.875602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895967-66bd-42ef-a2e5-76fa6155a489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80764bdc777d4da88bd81c5cfc69dd9f, user_id=47f29c2aa041417091a206a989bac8e9, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:57.877080 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c61869-726e-443b-9d25-5452c05e9bc3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:57.878460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11895967-66bd-42ef-a2e5-76fa6155a489 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:57.884989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:57.884989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.885473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.885880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.888702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:57.896082 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1062/2111] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:57 2022] PUT /identity/v3/projects/80764bdc777d4da88bd81c5cfc69dd9f/users/47f29c2aa041417091a206a989bac8e9/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:57.907028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698d5b-8bf9-49e5-a98c-d78770e6bc5f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:57.907413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698d5b-8bf9-49e5-a98c-d78770e6bc5f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:57.907825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d698d5b-8bf9-49e5-a98c-d78770e6bc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:57.940377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4d698d5b-8bf9-49e5-a98c-d78770e6bc5f None None] MFA Rules not processed for user `47f29c2aa041417091a206a989bac8e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:57.941625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4d698d5b-8bf9-49e5-a98c-d78770e6bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:57.965187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:57.966962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:57.977791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1050/2112] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:58.011565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1063/2113] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:19:58.015996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:58.027606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6687e-d6db-4cb8-b817-e31edcd8dabd service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:58.057427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:58.109850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc27e-888e-494a-914c-c3c22171d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:58.110465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc27e-888e-494a-914c-c3c22171d647 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:58.110795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc27e-888e-494a-914c-c3c22171d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:58.111167 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc27e-888e-494a-914c-c3c22171d647 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:58.111954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc27e-888e-494a-914c-c3c22171d647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:58.113947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc27e-888e-494a-914c-c3c22171d647 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:58.143875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1051/2114] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:19:58 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:58.148143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698d5b-8bf9-49e5-a98c-d78770e6bc5f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:58.174662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d698d5b-8bf9-49e5-a98c-d78770e6bc5f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:58.200460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:19:58.255437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860883-0c38-402c-8d6c-113703e9f4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:58.256125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860883-0c38-402c-8d6c-113703e9f4bb admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:58.256393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860883-0c38-402c-8d6c-113703e9f4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:58.256663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860883-0c38-402c-8d6c-113703e9f4bb admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:58.257504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860883-0c38-402c-8d6c-113703e9f4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:58.259478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860883-0c38-402c-8d6c-113703e9f4bb admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:58.291890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1064/2115] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:19:58 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:19:58.295998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc27e-888e-494a-914c-c3c22171d647 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:58.309966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc27e-888e-494a-914c-c3c22171d647 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:58.316887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc10c99-5e22-4f2b-af59-d689c14e2ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:58.318193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc10c99-5e22-4f2b-af59-d689c14e2ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:58.318480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc10c99-5e22-4f2b-af59-d689c14e2ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:58.318987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc10c99-5e22-4f2b-af59-d689c14e2ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:58.319756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc10c99-5e22-4f2b-af59-d689c14e2ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:58.322088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc10c99-5e22-4f2b-af59-d689c14e2ccb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:58.354409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860883-0c38-402c-8d6c-113703e9f4bb admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:58.354696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1052/2116] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:58.364469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860883-0c38-402c-8d6c-113703e9f4bb admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:58.371810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f9184-9830-4304-b9af-c4c2541d20be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:58.372495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9184-9830-4304-b9af-c4c2541d20be admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:58.372776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9184-9830-4304-b9af-c4c2541d20be admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:58.373046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9184-9830-4304-b9af-c4c2541d20be admin admin] PATH_INFO: `/v3/projects/966557247aa44930a0473c0c119b11b9/users/5760d5dc0b7949f997a4fcbeeee54241/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:58.396827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f9184-9830-4304-b9af-c4c2541d20be admin admin] RBAC: Authorizing `identity:create_grant(project_id=966557247aa44930a0473c0c119b11b9, user_id=5760d5dc0b7949f997a4fcbeeee54241, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:58.400660 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f9184-9830-4304-b9af-c4c2541d20be admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:58.419871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1065/2117] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:58 2022] PUT /identity/v3/projects/966557247aa44930a0473c0c119b11b9/users/5760d5dc0b7949f997a4fcbeeee54241/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:58.423719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc10c99-5e22-4f2b-af59-d689c14e2ccb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:58.439603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc10c99-5e22-4f2b-af59-d689c14e2ccb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:58.529745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859b469-05c6-4d24-8bdf-52d93a77aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:58.530818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b469-05c6-4d24-8bdf-52d93a77aac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:58.531285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b469-05c6-4d24-8bdf-52d93a77aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:58.531735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859b469-05c6-4d24-8bdf-52d93a77aac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:58.532601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859b469-05c6-4d24-8bdf-52d93a77aac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:58.534473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859b469-05c6-4d24-8bdf-52d93a77aac4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:58.553499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1053/2118] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:19:58.558622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f9184-9830-4304-b9af-c4c2541d20be admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:58.570746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f9184-9830-4304-b9af-c4c2541d20be admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:58.585055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa81be-c8c3-4f98-be6c-b913800040c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:58.585858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa81be-c8c3-4f98-be6c-b913800040c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:58.586143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa81be-c8c3-4f98-be6c-b913800040c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:58.587143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa81be-c8c3-4f98-be6c-b913800040c1 admin admin] PATH_INFO: `/v3/projects/966557247aa44930a0473c0c119b11b9/users/5760d5dc0b7949f997a4fcbeeee54241/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:58.589305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa81be-c8c3-4f98-be6c-b913800040c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966557247aa44930a0473c0c119b11b9, user_id=5760d5dc0b7949f997a4fcbeeee54241, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:58.593155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa81be-c8c3-4f98-be6c-b913800040c1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:58.617398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1066/2119] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:19:58 2022] PUT /identity/v3/projects/966557247aa44930a0473c0c119b11b9/users/5760d5dc0b7949f997a4fcbeeee54241/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:19:58.623801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef206d-a116-4cb5-912b-5405a0d59e5c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:58.624084 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef206d-a116-4cb5-912b-5405a0d59e5c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:58.624358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef206d-a116-4cb5-912b-5405a0d59e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:58.654638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5aef206d-a116-4cb5-912b-5405a0d59e5c None None] MFA Rules not processed for user `5760d5dc0b7949f997a4fcbeeee54241`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:19:58.655939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5aef206d-a116-4cb5-912b-5405a0d59e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:58.736979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1054/2120] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:19:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:19:58.749116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa81be-c8c3-4f98-be6c-b913800040c1 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:58.808826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa81be-c8c3-4f98-be6c-b913800040c1 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:58.812732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9a5ed-740d-4fc9-928d-e83d98c4fa03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:58.813423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9a5ed-740d-4fc9-928d-e83d98c4fa03 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:58.813711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9a5ed-740d-4fc9-928d-e83d98c4fa03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:58.813984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9a5ed-740d-4fc9-928d-e83d98c4fa03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:58.874240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9a5ed-740d-4fc9-928d-e83d98c4fa03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:19:58.875694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e9a5ed-740d-4fc9-928d-e83d98c4fa03 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:19:58.884812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1067/2121] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:19:59.923437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef206d-a116-4cb5-912b-5405a0d59e5c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:19:59.933818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef206d-a116-4cb5-912b-5405a0d59e5c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:19:59.937711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:19:59.938330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:19:59.938700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:19:59.938987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:19:59.940804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:19:59.960601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:00.009822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:00.011406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:00.022134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1055/2122] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:19:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:01.476132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9a5ed-740d-4fc9-928d-e83d98c4fa03 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:01.485342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e9a5ed-740d-4fc9-928d-e83d98c4fa03 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:01.489635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714db04b-3be9-4b8c-ada9-115232470d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:01.490243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db04b-3be9-4b8c-ada9-115232470d91 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:01.490518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db04b-3be9-4b8c-ada9-115232470d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:01.490785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714db04b-3be9-4b8c-ada9-115232470d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:01.507214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db04b-3be9-4b8c-ada9-115232470d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:01.510098 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714db04b-3be9-4b8c-ada9-115232470d91 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:01.528344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1068/2123] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:01.929555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:01.931366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:02.000688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13be8bc-fdc5-4a86-ad3b-b29da20030b7 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:02.005600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:02.006355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:02.006703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:02.006989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] PATH_INFO: `/v3/users/1ce57a9ea7d543758cee548b46c48d61` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:02.008649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce57a9ea7d543758cee548b46c48d61)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:02.010879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:02.082775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce57a9ea7d543758cee548b46c48d61'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.106931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce57a9ea7d543758cee548b46c48d61'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.121560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce57a9ea7d543758cee548b46c48d61'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.137762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce57a9ea7d543758cee548b46c48d61'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.138401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce57a9ea7d543758cee548b46c48d61'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.155707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1056/2124] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:01 2022] DELETE /identity/v3/users/1ce57a9ea7d543758cee548b46c48d61 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:02.160241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb4fb-5b0f-44e5-b60c-012701bbb0ed None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:02.160523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb4fb-5b0f-44e5-b60c-012701bbb0ed None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:02.160964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870cb4fb-5b0f-44e5-b60c-012701bbb0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:02.194528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-870cb4fb-5b0f-44e5-b60c-012701bbb0ed None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:02.196175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-870cb4fb-5b0f-44e5-b60c-012701bbb0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:02.205919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:02.279824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1069/2125] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:02.289625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:02.291170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:02.327078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:02.353013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894761d-4b28-446e-b110-f46301f911e7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:02.356804 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded39ae-e687-4d70-90b9-a27565d069f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:02.357461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded39ae-e687-4d70-90b9-a27565d069f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:02.357740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded39ae-e687-4d70-90b9-a27565d069f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:02.358027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded39ae-e687-4d70-90b9-a27565d069f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:02.368020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded39ae-e687-4d70-90b9-a27565d069f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:02.369637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded39ae-e687-4d70-90b9-a27565d069f0 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:02.380556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1057/2126] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:02.806416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cb4fb-5b0f-44e5-b60c-012701bbb0ed None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:02.807890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-870cb4fb-5b0f-44e5-b60c-012701bbb0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:02.822259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870cb4fb-5b0f-44e5-b60c-012701bbb0ed None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:02.826900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:02.827538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:02.827812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:02.828074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] PATH_INFO: `/v3/projects/e8a0c5c9e1134a0ea82f1ac830f55dcf` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:02.829492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a0c5c9e1134a0ea82f1ac830f55dcf)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:02.831380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:02.884898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a0c5c9e1134a0ea82f1ac830f55dcf', 'request_id': 'req-64f44f0b-b993-4376-83a5-e890d0ef6572'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.891635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a0c5c9e1134a0ea82f1ac830f55dcf', 'request_id': 'req-64f44f0b-b993-4376-83a5-e890d0ef6572'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.899256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a0c5c9e1134a0ea82f1ac830f55dcf', 'request_id': 'req-64f44f0b-b993-4376-83a5-e890d0ef6572'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.935996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] The token cache is being invalidate because project e8a0c5c9e1134a0ea82f1ac830f55dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:02.936357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.937284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:02.951695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1070/2127] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:02 2022] DELETE /identity/v3/projects/e8a0c5c9e1134a0ea82f1ac830f55dcf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:02.956481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded39ae-e687-4d70-90b9-a27565d069f0 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:02.975800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded39ae-e687-4d70-90b9-a27565d069f0 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:03.071082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:03.075377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:03.075668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:03.075944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] PATH_INFO: `/v3/users/71fa03f4e81e4f4d86c0660eca680202` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:03.077758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fa03f4e81e4f4d86c0660eca680202)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:03.079897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:03.146365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fa03f4e81e4f4d86c0660eca680202'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.164005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fa03f4e81e4f4d86c0660eca680202'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.171953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fa03f4e81e4f4d86c0660eca680202'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.183594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fa03f4e81e4f4d86c0660eca680202'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.184586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fa03f4e81e4f4d86c0660eca680202'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.193364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1058/2128] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:02 2022] DELETE /identity/v3/users/71fa03f4e81e4f4d86c0660eca680202 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:03.591454 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:03.593694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:03.612256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f44f0b-b993-4376-83a5-e890d0ef6572 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:03.713962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:03.714686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:03.715049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:03.715350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] PATH_INFO: `/v3/projects/80639cdc8c68421aaafd8bc1e57f2cc8` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:03.716498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80639cdc8c68421aaafd8bc1e57f2cc8)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:03.719012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:03.763122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:03.771035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80639cdc8c68421aaafd8bc1e57f2cc8', 'request_id': 'req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.778576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80639cdc8c68421aaafd8bc1e57f2cc8', 'request_id': 'req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.784866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80639cdc8c68421aaafd8bc1e57f2cc8', 'request_id': 'req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.798507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] The token cache is being invalidate because project 80639cdc8c68421aaafd8bc1e57f2cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:03.798730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.799350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.801197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1071/2129] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:03 2022] DELETE /identity/v3/projects/80639cdc8c68421aaafd8bc1e57f2cc8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:03.805327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:03.806916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:03.819810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed668f7-b454-4ef0-a346-6d919b901445 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:03.875931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:03.885906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:03.886732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:03.887347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:03.887716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] PATH_INFO: `/v3/users/2a81b4a338794d28861f31e25e085066` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:03.889181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a81b4a338794d28861f31e25e085066)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:03.891821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:03.943877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a81b4a338794d28861f31e25e085066'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.956439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a81b4a338794d28861f31e25e085066'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.963927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a81b4a338794d28861f31e25e085066'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.972995 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a81b4a338794d28861f31e25e085066'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.973705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a4a7e6d8-5f5e-4b66-a41d-0cfd132ea0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a81b4a338794d28861f31e25e085066'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:03.980416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1059/2130] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:03 2022] DELETE /identity/v3/users/2a81b4a338794d28861f31e25e085066 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:04.259421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:04.261057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:04.276888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec8b4b-47b0-43dc-b75e-c3a59bd92532 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:04.340869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:04.341561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:04.341830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:04.342105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] PATH_INFO: `/v3/projects/05db7aba56a54990b54a106e7a22c9dc` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:04.343258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=05db7aba56a54990b54a106e7a22c9dc)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:04.345183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:04.394986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05db7aba56a54990b54a106e7a22c9dc', 'request_id': 'req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:04.401752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05db7aba56a54990b54a106e7a22c9dc', 'request_id': 'req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:04.408822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05db7aba56a54990b54a106e7a22c9dc', 'request_id': 'req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:04.428137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] The token cache is being invalidate because project 05db7aba56a54990b54a106e7a22c9dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:04.429113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:04.430328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5cfe544f-4375-422c-9cb4-fcb5f71c2b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:04.432422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1072/2131] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:04 2022] DELETE /identity/v3/projects/05db7aba56a54990b54a106e7a22c9dc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:04.437023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83503c-aeb6-4a1e-a94b-edb0b5ef2a29 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:04.437338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83503c-aeb6-4a1e-a94b-edb0b5ef2a29 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:04.437613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83503c-aeb6-4a1e-a94b-edb0b5ef2a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:04.458478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7b83503c-aeb6-4a1e-a94b-edb0b5ef2a29 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:04.460386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7b83503c-aeb6-4a1e-a94b-edb0b5ef2a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:04.533313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1060/2132] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:04.539884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a938bb-39ee-4537-be31-880402e6243e None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:04.540169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a938bb-39ee-4537-be31-880402e6243e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:04.540444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a938bb-39ee-4537-be31-880402e6243e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:04.562101 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f1a938bb-39ee-4537-be31-880402e6243e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:04.563351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f1a938bb-39ee-4537-be31-880402e6243e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:04.571558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1073/2133] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:04.577252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83503c-aeb6-4a1e-a94b-edb0b5ef2a29 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:04.589586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83503c-aeb6-4a1e-a94b-edb0b5ef2a29 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:04.595022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:04.595950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:04.596126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:04.596399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:04.597126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:04.597445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:04.599093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:04.616045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1061/2134] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:20:04.619971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a938bb-39ee-4537-be31-880402e6243e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:04.633372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a938bb-39ee-4537-be31-880402e6243e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:04.639132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507cdd-c338-4248-8cc3-0ad3731ff1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:04.639753 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507cdd-c338-4248-8cc3-0ad3731ff1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:04.640033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507cdd-c338-4248-8cc3-0ad3731ff1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:04.640307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507cdd-c338-4248-8cc3-0ad3731ff1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:04.640976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99507cdd-c338-4248-8cc3-0ad3731ff1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:04.643018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99507cdd-c338-4248-8cc3-0ad3731ff1c4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:04.672104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1074/2135] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:04 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:04.676122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:04.687154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160c0cb-d7a7-4614-aa8e-cd6cfa5dfa7c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:04.812257 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ff1a0-f19a-488b-aa0c-954d55bdbc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:04.813132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ff1a0-f19a-488b-aa0c-954d55bdbc86 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:04.813380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ff1a0-f19a-488b-aa0c-954d55bdbc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:04.813556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ff1a0-f19a-488b-aa0c-954d55bdbc86 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:04.814204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ff1a0-f19a-488b-aa0c-954d55bdbc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:04.818709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ff1a0-f19a-488b-aa0c-954d55bdbc86 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:04.830249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:04.866727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1062/2136] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:04 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:04.867695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507cdd-c338-4248-8cc3-0ad3731ff1c4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:04.885149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507cdd-c338-4248-8cc3-0ad3731ff1c4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:04.891542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dbf6-4988-4362-a143-4d94752528a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:04.892241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dbf6-4988-4362-a143-4d94752528a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:04.892760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dbf6-4988-4362-a143-4d94752528a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:04.892870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dbf6-4988-4362-a143-4d94752528a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:04.893552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2dbf6-4988-4362-a143-4d94752528a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:04.895438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2dbf6-4988-4362-a143-4d94752528a1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:04.910240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1075/2137] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:04.914281 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ff1a0-f19a-488b-aa0c-954d55bdbc86 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:04.930005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ff1a0-f19a-488b-aa0c-954d55bdbc86 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:04.936763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea35738-5a56-4c29-a2b3-3860c9379afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:04.937517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35738-5a56-4c29-a2b3-3860c9379afe admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:04.937861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35738-5a56-4c29-a2b3-3860c9379afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:04.938194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea35738-5a56-4c29-a2b3-3860c9379afe admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:04.938908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea35738-5a56-4c29-a2b3-3860c9379afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:04.941325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea35738-5a56-4c29-a2b3-3860c9379afe admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:04.964482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1063/2138] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:20:04.968770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dbf6-4988-4362-a143-4d94752528a1 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:04.993038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dbf6-4988-4362-a143-4d94752528a1 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:05.004845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:05.005804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:05.006234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:05.006545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] PATH_INFO: `/v3/projects/f490a3d6909647429705a3df539df127/users/9a2eff24170c4ec6a2c5a7c7fc03315b/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:05.029403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f490a3d6909647429705a3df539df127, user_id=9a2eff24170c4ec6a2c5a7c7fc03315b, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:05.032749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:05.036667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:05.085255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1076/2139] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:04 2022] PUT /identity/v3/projects/f490a3d6909647429705a3df539df127/users/9a2eff24170c4ec6a2c5a7c7fc03315b/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:05.087659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde05a-1961-45cc-aa64-938e108805e1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:05.088029 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde05a-1961-45cc-aa64-938e108805e1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:05.089117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde05a-1961-45cc-aa64-938e108805e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:05.122837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-08cde05a-1961-45cc-aa64-938e108805e1 None None] MFA Rules not processed for user `9a2eff24170c4ec6a2c5a7c7fc03315b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:05.124688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-08cde05a-1961-45cc-aa64-938e108805e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:05.228138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1064/2140] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:05.235937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:05.238270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:05.305814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89913024-dd23-4f84-be67-8d5321a85a0b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:05.310988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748b42c-1c39-4135-8801-11b819f789bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:05.311949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b42c-1c39-4135-8801-11b819f789bd service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:05.312342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b42c-1c39-4135-8801-11b819f789bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:05.312723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b42c-1c39-4135-8801-11b819f789bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:05.323525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b42c-1c39-4135-8801-11b819f789bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:05.324945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b42c-1c39-4135-8801-11b819f789bd service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:05.334197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1077/2141] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:08.848760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde05a-1961-45cc-aa64-938e108805e1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:08.850768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-08cde05a-1961-45cc-aa64-938e108805e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:08.924964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde05a-1961-45cc-aa64-938e108805e1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:08.931089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:08.931900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:08.932323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:08.932653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] PATH_INFO: `/v3/users/949470c3e3eb4d72b003760b6c16302b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:08.934147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=949470c3e3eb4d72b003760b6c16302b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:08.936470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:08.992810 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949470c3e3eb4d72b003760b6c16302b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.005710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949470c3e3eb4d72b003760b6c16302b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.011910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:09.014472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949470c3e3eb4d72b003760b6c16302b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.022609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949470c3e3eb4d72b003760b6c16302b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.026255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949470c3e3eb4d72b003760b6c16302b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.032811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1065/2142] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:08 2022] DELETE /identity/v3/users/949470c3e3eb4d72b003760b6c16302b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:09.037506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac02e7-e0be-47f4-b872-c86cd767c0b1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:09.038883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac02e7-e0be-47f4-b872-c86cd767c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:09.038883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac02e7-e0be-47f4-b872-c86cd767c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:09.058906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d5ac02e7-e0be-47f4-b872-c86cd767c0b1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:09.060125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d5ac02e7-e0be-47f4-b872-c86cd767c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:09.122937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1078/2143] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:09.132936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:09.134631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:09.204071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9231b4-25db-4891-9efd-eb60a25de1eb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:09.208608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7f10-619a-4daa-8dbc-1f5c828e10da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:09.209406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7f10-619a-4daa-8dbc-1f5c828e10da service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:09.209833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7f10-619a-4daa-8dbc-1f5c828e10da service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:09.210339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7f10-619a-4daa-8dbc-1f5c828e10da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:09.220563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe7f10-619a-4daa-8dbc-1f5c828e10da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:09.222124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe7f10-619a-4daa-8dbc-1f5c828e10da service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:09.232275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1066/2144] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:09.527994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac02e7-e0be-47f4-b872-c86cd767c0b1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:09.529774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d5ac02e7-e0be-47f4-b872-c86cd767c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:09.544139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac02e7-e0be-47f4-b872-c86cd767c0b1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:09.549891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:09.550536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:09.550808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:09.551093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] PATH_INFO: `/v3/projects/ec895f51df2b4072b9d23c40c457271b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:09.552356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec895f51df2b4072b9d23c40c457271b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:09.554519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:09.609395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec895f51df2b4072b9d23c40c457271b', 'request_id': 'req-e5395c28-cc27-46af-ba0f-de8d5d65d48d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.615151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec895f51df2b4072b9d23c40c457271b', 'request_id': 'req-e5395c28-cc27-46af-ba0f-de8d5d65d48d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.621810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec895f51df2b4072b9d23c40c457271b', 'request_id': 'req-e5395c28-cc27-46af-ba0f-de8d5d65d48d'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.641931 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] The token cache is being invalidate because project ec895f51df2b4072b9d23c40c457271b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:09.642314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.642952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e5395c28-cc27-46af-ba0f-de8d5d65d48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:09.644774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1079/2145] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:09 2022] DELETE /identity/v3/projects/ec895f51df2b4072b9d23c40c457271b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:09.650038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54fbb7-e39b-4266-821b-fe0d050a55dc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:09.650414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54fbb7-e39b-4266-821b-fe0d050a55dc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:09.651061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54fbb7-e39b-4266-821b-fe0d050a55dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:09.672459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1a54fbb7-e39b-4266-821b-fe0d050a55dc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:09.673812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1a54fbb7-e39b-4266-821b-fe0d050a55dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:09.743367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1067/2146] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:09.751794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08867f9f-3b3a-44d8-bcae-54cb47c3db7b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:09.752343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08867f9f-3b3a-44d8-bcae-54cb47c3db7b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:09.753052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08867f9f-3b3a-44d8-bcae-54cb47c3db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:09.774637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-08867f9f-3b3a-44d8-bcae-54cb47c3db7b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:09.776175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-08867f9f-3b3a-44d8-bcae-54cb47c3db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:09.784434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1080/2147] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:09.789053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54fbb7-e39b-4266-821b-fe0d050a55dc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:09.800120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54fbb7-e39b-4266-821b-fe0d050a55dc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:09.807067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:09.808568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:09.808856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:09.809156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:09.809816 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:09.810119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:09.811728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:09.828874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1068/2148] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:20:09.830047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08867f9f-3b3a-44d8-bcae-54cb47c3db7b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:09.839883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08867f9f-3b3a-44d8-bcae-54cb47c3db7b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:09.844493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1507b-cb16-4664-8f8e-eb5f1f4f9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:09.845106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1507b-cb16-4664-8f8e-eb5f1f4f9335 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:09.845398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1507b-cb16-4664-8f8e-eb5f1f4f9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:09.845668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1507b-cb16-4664-8f8e-eb5f1f4f9335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:09.846299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1507b-cb16-4664-8f8e-eb5f1f4f9335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:09.848182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1507b-cb16-4664-8f8e-eb5f1f4f9335 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:09.859561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:09.882903 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1081/2149] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:09 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:09.884202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:09.894411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7122-df7d-4e41-a254-10933eacbb2b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:09.957546 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40074b-3a2d-4391-adeb-2f6c5e4996ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:09.958162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40074b-3a2d-4391-adeb-2f6c5e4996ec admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:09.958434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40074b-3a2d-4391-adeb-2f6c5e4996ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:09.958703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40074b-3a2d-4391-adeb-2f6c5e4996ec admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:09.959471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40074b-3a2d-4391-adeb-2f6c5e4996ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:09.961483 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40074b-3a2d-4391-adeb-2f6c5e4996ec admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:09.985981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1069/2150] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:09 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:09.989196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1507b-cb16-4664-8f8e-eb5f1f4f9335 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:10.000463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1507b-cb16-4664-8f8e-eb5f1f4f9335 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:10.005524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14224c-1c54-485f-b463-71f446e52e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:10.006133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14224c-1c54-485f-b463-71f446e52e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:10.006450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14224c-1c54-485f-b463-71f446e52e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:10.006778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14224c-1c54-485f-b463-71f446e52e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:10.007718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14224c-1c54-485f-b463-71f446e52e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:10.009514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14224c-1c54-485f-b463-71f446e52e8e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:10.020929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1082/2151] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:20:10.025267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40074b-3a2d-4391-adeb-2f6c5e4996ec admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:10.036345 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40074b-3a2d-4391-adeb-2f6c5e4996ec admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:10.041595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c728c-ea92-4524-846c-0c4e15da96c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:10.042193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c728c-ea92-4524-846c-0c4e15da96c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:10.042457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c728c-ea92-4524-846c-0c4e15da96c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:10.042764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c728c-ea92-4524-846c-0c4e15da96c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:10.043410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c728c-ea92-4524-846c-0c4e15da96c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:10.044993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c728c-ea92-4524-846c-0c4e15da96c7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:10.047336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:10.057649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1070/2152] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:20:10.062042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14224c-1c54-485f-b463-71f446e52e8e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:10.072494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14224c-1c54-485f-b463-71f446e52e8e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:10.077111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:10.077766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:10.078052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:10.078320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] PATH_INFO: `/v3/projects/e1f423fe291048058e38ae4c297b7732/users/0eecd16cc21b493db3a0f462c30ef75a/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:10.101415 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f423fe291048058e38ae4c297b7732, user_id=0eecd16cc21b493db3a0f462c30ef75a, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:10.105762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:10.124092 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1083/2153] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:10 2022] PUT /identity/v3/projects/e1f423fe291048058e38ae4c297b7732/users/0eecd16cc21b493db3a0f462c30ef75a/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:10.138025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ea97-b051-4497-ac73-2106eccd9ff2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:10.138316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ea97-b051-4497-ac73-2106eccd9ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:10.138589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ea97-b051-4497-ac73-2106eccd9ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:10.168811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2f97ea97-b051-4497-ac73-2106eccd9ff2 None None] MFA Rules not processed for user `0eecd16cc21b493db3a0f462c30ef75a`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:10.170077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2f97ea97-b051-4497-ac73-2106eccd9ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:10.240097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1071/2154] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:10.252392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:10.254463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:10.316068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d5732-fa78-4f2b-97d4-2071e9e851db admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:10.319703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439df7c-5765-4523-b616-43f066bc2ee6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f45db0ea864a3299cccd7a74b7271b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:10.320315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439df7c-5765-4523-b616-43f066bc2ee6 service glance] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:10.320595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439df7c-5765-4523-b616-43f066bc2ee6 service glance] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:10.320866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439df7c-5765-4523-b616-43f066bc2ee6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:10.330346 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439df7c-5765-4523-b616-43f066bc2ee6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:10.331816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439df7c-5765-4523-b616-43f066bc2ee6 service glance] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:10.340794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1084/2155] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:10.467192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97ea97-b051-4497-ac73-2106eccd9ff2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:10.468837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2f97ea97-b051-4497-ac73-2106eccd9ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:10.545289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97ea97-b051-4497-ac73-2106eccd9ff2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:10.550705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:10.551344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:10.551626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:10.551897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] PATH_INFO: `/v3/users/9a2eff24170c4ec6a2c5a7c7fc03315b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:10.553020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2eff24170c4ec6a2c5a7c7fc03315b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:10.554996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:10.639838 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2eff24170c4ec6a2c5a7c7fc03315b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:10.654843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2eff24170c4ec6a2c5a7c7fc03315b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:10.663535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2eff24170c4ec6a2c5a7c7fc03315b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:10.674854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2eff24170c4ec6a2c5a7c7fc03315b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:10.675469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2eff24170c4ec6a2c5a7c7fc03315b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:10.682820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1072/2156] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:10 2022] DELETE /identity/v3/users/9a2eff24170c4ec6a2c5a7c7fc03315b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:10.687384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854bcc-023f-4e40-8025-861236d7d282 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:10.687734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854bcc-023f-4e40-8025-861236d7d282 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:10.688068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97854bcc-023f-4e40-8025-861236d7d282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:10.707458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-97854bcc-023f-4e40-8025-861236d7d282 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:10.708861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-97854bcc-023f-4e40-8025-861236d7d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:10.786059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1085/2157] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:10.796934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:10.799127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:10.814083 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:10.907311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52dd5e-4047-47ee-9d7b-5eb4b1d22a9c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:10.912475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0f620-5403-40b4-aad1-422b5b37ae7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:10.913230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0f620-5403-40b4-aad1-422b5b37ae7f service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:10.913550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0f620-5403-40b4-aad1-422b5b37ae7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:10.914098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0f620-5403-40b4-aad1-422b5b37ae7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:10.923848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0f620-5403-40b4-aad1-422b5b37ae7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:10.925315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0f620-5403-40b4-aad1-422b5b37ae7f service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:10.935873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1073/2158] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:11.356027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854bcc-023f-4e40-8025-861236d7d282 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:11.358099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-97854bcc-023f-4e40-8025-861236d7d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:11.375249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97854bcc-023f-4e40-8025-861236d7d282 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:11.380322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:11.381503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:11.382122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:11.382623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] PATH_INFO: `/v3/projects/f490a3d6909647429705a3df539df127` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:11.384144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f490a3d6909647429705a3df539df127)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:11.386530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:11.485527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f490a3d6909647429705a3df539df127', 'request_id': 'req-ae46be82-016e-44e6-8315-385e8700b261'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:11.492208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:11.501009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f490a3d6909647429705a3df539df127', 'request_id': 'req-ae46be82-016e-44e6-8315-385e8700b261'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:11.512859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f490a3d6909647429705a3df539df127', 'request_id': 'req-ae46be82-016e-44e6-8315-385e8700b261'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:11.540902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] The token cache is being invalidate because project f490a3d6909647429705a3df539df127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:11.541319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:11.543727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:11.543727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1086/2159] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:11 2022] DELETE /identity/v3/projects/f490a3d6909647429705a3df539df127 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:12.579025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901d70-350b-4650-8041-a345344e7ad1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:12.579595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901d70-350b-4650-8041-a345344e7ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:12.579595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f901d70-350b-4650-8041-a345344e7ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:12.601205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3f901d70-350b-4650-8041-a345344e7ad1 None None] MFA Rules not processed for user `df1a5792ffa94afd813c3f0f526890af`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:12.602475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3f901d70-350b-4650-8041-a345344e7ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:12.667392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1074/2160] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:14.419557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:14.421010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:14.494904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46be82-016e-44e6-8315-385e8700b261 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:14.499813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:14.500519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:14.500835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:14.501145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] PATH_INFO: `/v3/users/47f29c2aa041417091a206a989bac8e9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:14.502443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f29c2aa041417091a206a989bac8e9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:14.504334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:14.555441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f29c2aa041417091a206a989bac8e9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:14.556099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f29c2aa041417091a206a989bac8e9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:14.567892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f29c2aa041417091a206a989bac8e9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:14.575596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f29c2aa041417091a206a989bac8e9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:14.587637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f29c2aa041417091a206a989bac8e9'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:14.594257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1087/2161] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:14 2022] DELETE /identity/v3/users/47f29c2aa041417091a206a989bac8e9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:14.598989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669743-f8c5-47fa-bb30-7149320352cb None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:14.599468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669743-f8c5-47fa-bb30-7149320352cb None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:14.599584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669743-f8c5-47fa-bb30-7149320352cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:14.620635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-55669743-f8c5-47fa-bb30-7149320352cb None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:14.622039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-55669743-f8c5-47fa-bb30-7149320352cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:14.687921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1075/2162] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:14.697844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:14.699347 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:14.773412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd24c76-3298-4708-b03c-a11c6725e436 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:14.778155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf98055-6eb7-4c1d-adb7-4a9634c7255b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:14.778763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf98055-6eb7-4c1d-adb7-4a9634c7255b service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:14.779036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf98055-6eb7-4c1d-adb7-4a9634c7255b service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:14.779297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf98055-6eb7-4c1d-adb7-4a9634c7255b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:14.789565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf98055-6eb7-4c1d-adb7-4a9634c7255b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:14.790970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf98055-6eb7-4c1d-adb7-4a9634c7255b service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:14.801035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1088/2163] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:15.188639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55669743-f8c5-47fa-bb30-7149320352cb None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:15.190181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-55669743-f8c5-47fa-bb30-7149320352cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:15.208694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55669743-f8c5-47fa-bb30-7149320352cb None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:15.214465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:15.215124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:15.215321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:15.215594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] PATH_INFO: `/v3/projects/80764bdc777d4da88bd81c5cfc69dd9f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:15.216826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80764bdc777d4da88bd81c5cfc69dd9f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:15.219131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:15.269041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80764bdc777d4da88bd81c5cfc69dd9f', 'request_id': 'req-313ff522-e11a-4d9e-9a93-4fa9dba49893'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.270792 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:15.278530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80764bdc777d4da88bd81c5cfc69dd9f', 'request_id': 'req-313ff522-e11a-4d9e-9a93-4fa9dba49893'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.284566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80764bdc777d4da88bd81c5cfc69dd9f', 'request_id': 'req-313ff522-e11a-4d9e-9a93-4fa9dba49893'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.298196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] The token cache is being invalidate because project 80764bdc777d4da88bd81c5cfc69dd9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:15.298489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.299242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.300827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1076/2164] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:15 2022] DELETE /identity/v3/projects/80764bdc777d4da88bd81c5cfc69dd9f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:15.305342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf98055-6eb7-4c1d-adb7-4a9634c7255b service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:15.316203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:15.321323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf98055-6eb7-4c1d-adb7-4a9634c7255b service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:15.388238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:15.388985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:15.389211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:15.389487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] PATH_INFO: `/v3/users/5760d5dc0b7949f997a4fcbeeee54241` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:15.390623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5760d5dc0b7949f997a4fcbeeee54241)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:15.392643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:15.465852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5760d5dc0b7949f997a4fcbeeee54241'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.466854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5760d5dc0b7949f997a4fcbeeee54241'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.486942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5760d5dc0b7949f997a4fcbeeee54241'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.496865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5760d5dc0b7949f997a4fcbeeee54241'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.506727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e53d6726-dc2d-41d1-8b18-333663a955d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5760d5dc0b7949f997a4fcbeeee54241'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:15.527479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1089/2165] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:15 2022] DELETE /identity/v3/users/5760d5dc0b7949f997a4fcbeeee54241 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:16.032286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:16.034179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:16.048999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ff522-e11a-4d9e-9a93-4fa9dba49893 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:16.134176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:16.134889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.135170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.135446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] PATH_INFO: `/v3/projects/966557247aa44930a0473c0c119b11b9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.136603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] RBAC: Authorizing `identity:delete_project(project_id=966557247aa44930a0473c0c119b11b9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:16.139258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:16.199032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966557247aa44930a0473c0c119b11b9', 'request_id': 'req-ffd23ec2-216f-4902-b143-57cc03d0255b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:16.209905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966557247aa44930a0473c0c119b11b9', 'request_id': 'req-ffd23ec2-216f-4902-b143-57cc03d0255b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:16.217268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966557247aa44930a0473c0c119b11b9', 'request_id': 'req-ffd23ec2-216f-4902-b143-57cc03d0255b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:16.233858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] The token cache is being invalidate because project 966557247aa44930a0473c0c119b11b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:16.234211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:16.234818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ffd23ec2-216f-4902-b143-57cc03d0255b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:16.236615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1077/2166] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:16 2022] DELETE /identity/v3/projects/966557247aa44930a0473c0c119b11b9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:16.242265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4730b5-65ed-4e88-93c3-0645361b5eed None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.242603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4730b5-65ed-4e88-93c3-0645361b5eed None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.242916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4730b5-65ed-4e88-93c3-0645361b5eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.268570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9d4730b5-65ed-4e88-93c3-0645361b5eed None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:16.269830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9d4730b5-65ed-4e88-93c3-0645361b5eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:16.343414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1090/2167] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:16.351684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b29d-7a20-4309-a640-3fe98560af63 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.352157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b29d-7a20-4309-a640-3fe98560af63 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.352601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b29d-7a20-4309-a640-3fe98560af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.375905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4e35b29d-7a20-4309-a640-3fe98560af63 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:16.377274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4e35b29d-7a20-4309-a640-3fe98560af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:16.387990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1078/2168] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:16.392234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4730b5-65ed-4e88-93c3-0645361b5eed None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:16.404109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4730b5-65ed-4e88-93c3-0645361b5eed None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:16.410164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:16.410910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.411313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.411612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.412390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:16.412858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:16.417523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:16.431377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1091/2169] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:20:16.435828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35b29d-7a20-4309-a640-3fe98560af63 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:16.446416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35b29d-7a20-4309-a640-3fe98560af63 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:16.455919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ed18-f400-4754-95df-c86fb8270d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:16.456562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ed18-f400-4754-95df-c86fb8270d6b admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.456840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ed18-f400-4754-95df-c86fb8270d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.457133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927ed18-f400-4754-95df-c86fb8270d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.457890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ed18-f400-4754-95df-c86fb8270d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:16.459760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927ed18-f400-4754-95df-c86fb8270d6b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:16.501680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1079/2170] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:16 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:16.503444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:16.519100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa955920-3ef6-4295-a4c3-244a3e71438d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:16.536532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:16.614576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138217-4d1f-426a-9a04-c653f936614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:16.615386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138217-4d1f-426a-9a04-c653f936614a admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.615669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138217-4d1f-426a-9a04-c653f936614a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.616088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138217-4d1f-426a-9a04-c653f936614a admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.621985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6138217-4d1f-426a-9a04-c653f936614a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:16.624484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6138217-4d1f-426a-9a04-c653f936614a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:16.661606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1092/2171] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:16 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:16.665886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ed18-f400-4754-95df-c86fb8270d6b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:16.680360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927ed18-f400-4754-95df-c86fb8270d6b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:16.685833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9f7f-b549-4b4c-9d87-bf80f9ad0e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:16.687192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9f7f-b549-4b4c-9d87-bf80f9ad0e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.687962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9f7f-b549-4b4c-9d87-bf80f9ad0e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.687962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9f7f-b549-4b4c-9d87-bf80f9ad0e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.688592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b9f7f-b549-4b4c-9d87-bf80f9ad0e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:16.690332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b9f7f-b549-4b4c-9d87-bf80f9ad0e5a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:16.702233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1080/2172] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:16.706888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138217-4d1f-426a-9a04-c653f936614a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:16.723983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138217-4d1f-426a-9a04-c653f936614a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:16.732805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28584da6-2273-4562-852e-ae9cbc1c3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:16.733817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28584da6-2273-4562-852e-ae9cbc1c3453 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.735317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28584da6-2273-4562-852e-ae9cbc1c3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.735805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28584da6-2273-4562-852e-ae9cbc1c3453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.737040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28584da6-2273-4562-852e-ae9cbc1c3453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:16.740907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28584da6-2273-4562-852e-ae9cbc1c3453 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:16.761610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1093/2173] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:20:16.766199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9f7f-b549-4b4c-9d87-bf80f9ad0e5a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:16.781352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9f7f-b549-4b4c-9d87-bf80f9ad0e5a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:16.787926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db117fb-a9c9-4bfa-bae7-0190d76b22e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:16.789640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db117fb-a9c9-4bfa-bae7-0190d76b22e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.790003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db117fb-a9c9-4bfa-bae7-0190d76b22e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.790343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db117fb-a9c9-4bfa-bae7-0190d76b22e3 admin admin] PATH_INFO: `/v3/projects/201305d1b80145cd808c24c4f6121c45/users/4459881f1b024d15907737dfd68de0a7/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.818773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db117fb-a9c9-4bfa-bae7-0190d76b22e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201305d1b80145cd808c24c4f6121c45, user_id=4459881f1b024d15907737dfd68de0a7, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:16.825299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db117fb-a9c9-4bfa-bae7-0190d76b22e3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:16.843451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1081/2174] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:16 2022] PUT /identity/v3/projects/201305d1b80145cd808c24c4f6121c45/users/4459881f1b024d15907737dfd68de0a7/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:16.854177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873975b-46c0-4363-a53f-afe9f3f93aae None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:16.854899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873975b-46c0-4363-a53f-afe9f3f93aae None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:16.855464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873975b-46c0-4363-a53f-afe9f3f93aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:16.932411 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7873975b-46c0-4363-a53f-afe9f3f93aae None None] MFA Rules not processed for user `4459881f1b024d15907737dfd68de0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:16.933770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7873975b-46c0-4363-a53f-afe9f3f93aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:17.069013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1094/2175] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:17.073377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db117fb-a9c9-4bfa-bae7-0190d76b22e3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:17.081172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:17.151176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db117fb-a9c9-4bfa-bae7-0190d76b22e3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:17.156214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fcd43-bc26-4b95-96b8-fd07f4146156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:17.156697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fcd43-bc26-4b95-96b8-fd07f4146156 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.156991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fcd43-bc26-4b95-96b8-fd07f4146156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.157358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fcd43-bc26-4b95-96b8-fd07f4146156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:17.158027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fcd43-bc26-4b95-96b8-fd07f4146156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:17.160395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979fcd43-bc26-4b95-96b8-fd07f4146156 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:17.213056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1082/2176] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:17 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:17.215245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873975b-46c0-4363-a53f-afe9f3f93aae None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:17.237645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873975b-46c0-4363-a53f-afe9f3f93aae None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:17.317764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213af42-d168-4149-af5e-6ab812d4ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:17.318884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213af42-d168-4149-af5e-6ab812d4ea43 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.318884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213af42-d168-4149-af5e-6ab812d4ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.319118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213af42-d168-4149-af5e-6ab812d4ea43 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:17.319796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213af42-d168-4149-af5e-6ab812d4ea43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:17.322207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213af42-d168-4149-af5e-6ab812d4ea43 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:17.360947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1095/2177] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:17 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:17.363014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fcd43-bc26-4b95-96b8-fd07f4146156 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:17.375631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fcd43-bc26-4b95-96b8-fd07f4146156 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:17.397222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba4fd0-7e6f-4f6a-86b2-a65ec8c21730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:17.398045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba4fd0-7e6f-4f6a-86b2-a65ec8c21730 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.398320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba4fd0-7e6f-4f6a-86b2-a65ec8c21730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.398594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba4fd0-7e6f-4f6a-86b2-a65ec8c21730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:17.399284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba4fd0-7e6f-4f6a-86b2-a65ec8c21730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:17.401246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba4fd0-7e6f-4f6a-86b2-a65ec8c21730 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:17.414976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1083/2178] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:17.420082 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213af42-d168-4149-af5e-6ab812d4ea43 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:17.432438 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213af42-d168-4149-af5e-6ab812d4ea43 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:17.442465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd7d5-7a4b-4b18-9220-4aee624af6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:17.443183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd7d5-7a4b-4b18-9220-4aee624af6da admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.443463 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd7d5-7a4b-4b18-9220-4aee624af6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.443746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfd7d5-7a4b-4b18-9220-4aee624af6da admin admin] PATH_INFO: `/v3/projects/5010a8fae98b469e8cc00712b50600c3/users/aeb7c8936a074fa88612189f090c1f08/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:17.448117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:17.463727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfd7d5-7a4b-4b18-9220-4aee624af6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5010a8fae98b469e8cc00712b50600c3, user_id=aeb7c8936a074fa88612189f090c1f08, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:17.466357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfd7d5-7a4b-4b18-9220-4aee624af6da admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:17.481646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1096/2179] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:17 2022] PUT /identity/v3/projects/5010a8fae98b469e8cc00712b50600c3/users/aeb7c8936a074fa88612189f090c1f08/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:17.490071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba4fd0-7e6f-4f6a-86b2-a65ec8c21730 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:17.503046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba4fd0-7e6f-4f6a-86b2-a65ec8c21730 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:17.578069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a609b-299e-41b1-9586-b61184c8db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:17.578710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a609b-299e-41b1-9586-b61184c8db9d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.578988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a609b-299e-41b1-9586-b61184c8db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.579656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a609b-299e-41b1-9586-b61184c8db9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:17.579892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a609b-299e-41b1-9586-b61184c8db9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:17.581769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a609b-299e-41b1-9586-b61184c8db9d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:17.593707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1084/2180] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:17.598525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd7d5-7a4b-4b18-9220-4aee624af6da admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:17.609535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfd7d5-7a4b-4b18-9220-4aee624af6da admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:17.614810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:17.615603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.615945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.616301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] PATH_INFO: `/v3/projects/5010a8fae98b469e8cc00712b50600c3/users/aeb7c8936a074fa88612189f090c1f08/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:17.618435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5010a8fae98b469e8cc00712b50600c3, user_id=aeb7c8936a074fa88612189f090c1f08, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:17.621180 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:17.639706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1097/2181] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:17 2022] PUT /identity/v3/projects/5010a8fae98b469e8cc00712b50600c3/users/aeb7c8936a074fa88612189f090c1f08/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:17.652742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086035fe-afd1-43cb-b567-c7eef4791857 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.653303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086035fe-afd1-43cb-b567-c7eef4791857 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.653697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086035fe-afd1-43cb-b567-c7eef4791857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:17.685558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-086035fe-afd1-43cb-b567-c7eef4791857 None None] MFA Rules not processed for user `aeb7c8936a074fa88612189f090c1f08`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:17.686698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-086035fe-afd1-43cb-b567-c7eef4791857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:17.766323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:17.772714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1085/2182] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:17.786497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:17.789318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:17.864282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870144a-f866-4778-9e36-db31079730a6 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:17.868975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd32a0-07df-4427-af4c-810de814050b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:17.869662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd32a0-07df-4427-af4c-810de814050b service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.869940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd32a0-07df-4427-af4c-810de814050b service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.870303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd32a0-07df-4427-af4c-810de814050b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:17.882291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd32a0-07df-4427-af4c-810de814050b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:17.884379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd32a0-07df-4427-af4c-810de814050b service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:17.896804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1098/2183] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:17.951722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086035fe-afd1-43cb-b567-c7eef4791857 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:17.953239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-086035fe-afd1-43cb-b567-c7eef4791857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:17.968798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086035fe-afd1-43cb-b567-c7eef4791857 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:17.974315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784a7f7-f8cc-48c5-b369-5f67426a865f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:17.975000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784a7f7-f8cc-48c5-b369-5f67426a865f service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:17.975386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784a7f7-f8cc-48c5-b369-5f67426a865f service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:17.975718 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784a7f7-f8cc-48c5-b369-5f67426a865f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:18.070530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784a7f7-f8cc-48c5-b369-5f67426a865f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:18.072164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784a7f7-f8cc-48c5-b369-5f67426a865f service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:18.083733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1086/2184] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:20.512760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2112e7-fe7d-43a7-834d-889024a426e4 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:20.513279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2112e7-fe7d-43a7-834d-889024a426e4 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:20.513279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2112e7-fe7d-43a7-834d-889024a426e4 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:20.514657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1099/2185] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:20:20.543064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3a07-d111-4c22-8397-ac38cc71171a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:20.543576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3a07-d111-4c22-8397-ac38cc71171a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:20.543767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3a07-d111-4c22-8397-ac38cc71171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:20.569240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-becf3a07-d111-4c22-8397-ac38cc71171a None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:20.570701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-becf3a07-d111-4c22-8397-ac38cc71171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:20.660307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1087/2186] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:20:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:20.675416 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02610-41c3-4b92-aa33-4aed0a819c81 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:20.675823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02610-41c3-4b92-aa33-4aed0a819c81 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:20.676278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b02610-41c3-4b92-aa33-4aed0a819c81 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:20.677874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1100/2187] 10.222.0.17 () {54 vars in 961 bytes} [Wed Aug 31 05:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:20:20.683319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd5f7-169f-412e-a715-19c23b53bc55 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:20.683790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd5f7-169f-412e-a715-19c23b53bc55 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:20.684153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd5f7-169f-412e-a715-19c23b53bc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:20.707525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3b3cd5f7-169f-412e-a715-19c23b53bc55 None None] MFA Rules not processed for user `72030c047a444f81ba3c482f99f78486`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:20.708803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3b3cd5f7-169f-412e-a715-19c23b53bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:20.724022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1088/2188] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Aug 31 05:20:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:20.732651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b02610-41c3-4b92-aa33-4aed0a819c81 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:20.749824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b02610-41c3-4b92-aa33-4aed0a819c81 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:20.755190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ac11-cda5-4232-910a-995b011405e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:20.755898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ac11-cda5-4232-910a-995b011405e8 service placement] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:20.756246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ac11-cda5-4232-910a-995b011405e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:20.756628 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161ac11-cda5-4232-910a-995b011405e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:20.770251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ac11-cda5-4232-910a-995b011405e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:20.771892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161ac11-cda5-4232-910a-995b011405e8 service placement] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:20.785495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1101/2189] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:21.326392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cd5f7-169f-412e-a715-19c23b53bc55 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:21.328480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3b3cd5f7-169f-412e-a715-19c23b53bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:21.418956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cd5f7-169f-412e-a715-19c23b53bc55 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:21.427775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:21.428552 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:21.429488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:21.429780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] PATH_INFO: `/v3/users/e8f57b4bdcbb4bb291ff8c34308410ea` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:21.431246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f57b4bdcbb4bb291ff8c34308410ea)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:21.433211 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:21.475319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:21.502974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f57b4bdcbb4bb291ff8c34308410ea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.527956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f57b4bdcbb4bb291ff8c34308410ea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.539388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f57b4bdcbb4bb291ff8c34308410ea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.551082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f57b4bdcbb4bb291ff8c34308410ea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.552187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f57b4bdcbb4bb291ff8c34308410ea'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.561574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1089/2190] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:21 2022] DELETE /identity/v3/users/e8f57b4bdcbb4bb291ff8c34308410ea => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:21.734816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ac11-cda5-4232-910a-995b011405e8 service placement] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:21.746209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161ac11-cda5-4232-910a-995b011405e8 service placement] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:21.773199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:21.774695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:21.844337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:21.845112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:21.845473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:21.845814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] PATH_INFO: `/v3/users/4459881f1b024d15907737dfd68de0a7` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:21.847328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4459881f1b024d15907737dfd68de0a7)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:21.849571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:21.859043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34516add-4f18-4683-bad0-6a730ba223d3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:21.864958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:21.865675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:21.865968 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:21.866242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] PATH_INFO: `/v3/projects/7f9200185d15456f99b4f39c3b4104f3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:21.869308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9200185d15456f99b4f39c3b4104f3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:21.871630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:21.914157 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4459881f1b024d15907737dfd68de0a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.915010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4459881f1b024d15907737dfd68de0a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.928179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:21.930554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4459881f1b024d15907737dfd68de0a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.932005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9200185d15456f99b4f39c3b4104f3', 'request_id': 'req-08960a76-722c-499c-bc01-3ab0f8a30a1c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.941076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9200185d15456f99b4f39c3b4104f3', 'request_id': 'req-08960a76-722c-499c-bc01-3ab0f8a30a1c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.947558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4459881f1b024d15907737dfd68de0a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.960906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9200185d15456f99b4f39c3b4104f3', 'request_id': 'req-08960a76-722c-499c-bc01-3ab0f8a30a1c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.965629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e18ee586-1bc7-4e5b-aaa3-a28fa0ba22b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4459881f1b024d15907737dfd68de0a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.966466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] The token cache is being invalidate because project 7f9200185d15456f99b4f39c3b4104f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:21.966735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.967539 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:21.969036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1090/2191] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:21 2022] DELETE /identity/v3/projects/7f9200185d15456f99b4f39c3b4104f3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:21.972857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:21.974518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:21.974983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1102/2192] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:21 2022] DELETE /identity/v3/users/4459881f1b024d15907737dfd68de0a7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:21.979630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04e2a-e55d-4dfe-a336-7a7e8b752236 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:21.980015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04e2a-e55d-4dfe-a336-7a7e8b752236 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:21.980459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04e2a-e55d-4dfe-a336-7a7e8b752236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.001800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-10c04e2a-e55d-4dfe-a336-7a7e8b752236 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:22.003061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-10c04e2a-e55d-4dfe-a336-7a7e8b752236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:22.021207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:22.051356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08960a76-722c-499c-bc01-3ab0f8a30a1c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:22.078174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1103/2193] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:22.089309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04e2a-e55d-4dfe-a336-7a7e8b752236 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:22.091707 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-10c04e2a-e55d-4dfe-a336-7a7e8b752236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:22.120155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:22.121072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.121398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.121689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] PATH_INFO: `/v3/users/a8b8b007ce2b4aa8b636a09e4eefe3b6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.126469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b8b007ce2b4aa8b636a09e4eefe3b6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:22.128459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:22.161042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04e2a-e55d-4dfe-a336-7a7e8b752236 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:22.165474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f26ef-7527-450b-9a38-53b316a7fae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:22.166136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f26ef-7527-450b-9a38-53b316a7fae3 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.166706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f26ef-7527-450b-9a38-53b316a7fae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.166816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f26ef-7527-450b-9a38-53b316a7fae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.177049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f26ef-7527-450b-9a38-53b316a7fae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:22.178633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f26ef-7527-450b-9a38-53b316a7fae3 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:22.187117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b8b007ce2b4aa8b636a09e4eefe3b6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.194462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1104/2194] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:22.202423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b8b007ce2b4aa8b636a09e4eefe3b6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.209984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b8b007ce2b4aa8b636a09e4eefe3b6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.218682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b8b007ce2b4aa8b636a09e4eefe3b6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.219405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b8b007ce2b4aa8b636a09e4eefe3b6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.226568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1091/2195] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:21 2022] DELETE /identity/v3/users/a8b8b007ce2b4aa8b636a09e4eefe3b6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:22.450862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f26ef-7527-450b-9a38-53b316a7fae3 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:22.462151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f26ef-7527-450b-9a38-53b316a7fae3 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:22.537212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:22.539538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:22.539672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:22.540407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.540777 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.541170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] PATH_INFO: `/v3/projects/fbe0cbe93feb4cf680cab681a6aa300e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.542403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe0cbe93feb4cf680cab681a6aa300e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:22.544402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:22.555723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cdcc0-81a4-42fc-8c4d-47ed487fc084 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:22.561468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:22.562570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.563002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.563424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] PATH_INFO: `/v3/projects/201305d1b80145cd808c24c4f6121c45` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.564734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=201305d1b80145cd808c24c4f6121c45)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:22.566860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:22.608752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:22.629453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201305d1b80145cd808c24c4f6121c45', 'request_id': 'req-8ea17dd5-b56f-48d2-8945-c0c94375af1c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.631973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe0cbe93feb4cf680cab681a6aa300e', 'request_id': 'req-e03eb1fe-043b-4437-ae3c-eef0d861dd84'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.638110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201305d1b80145cd808c24c4f6121c45', 'request_id': 'req-8ea17dd5-b56f-48d2-8945-c0c94375af1c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.639218 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe0cbe93feb4cf680cab681a6aa300e', 'request_id': 'req-e03eb1fe-043b-4437-ae3c-eef0d861dd84'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.640597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:22.646249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201305d1b80145cd808c24c4f6121c45', 'request_id': 'req-8ea17dd5-b56f-48d2-8945-c0c94375af1c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.646446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe0cbe93feb4cf680cab681a6aa300e', 'request_id': 'req-e03eb1fe-043b-4437-ae3c-eef0d861dd84'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.660116 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] The token cache is being invalidate because project 201305d1b80145cd808c24c4f6121c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:22.660305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] The token cache is being invalidate because project fbe0cbe93feb4cf680cab681a6aa300e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:22.660476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.660715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.661373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.663380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1092/2196] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:22 2022] DELETE /identity/v3/projects/201305d1b80145cd808c24c4f6121c45 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:22.666455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e03eb1fe-043b-4437-ae3c-eef0d861dd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.666966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1105/2197] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:22 2022] DELETE /identity/v3/projects/fbe0cbe93feb4cf680cab681a6aa300e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:22.667349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:22.668769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:22.671414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e4659-8730-4d44-be87-b78ef2a6003f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.671698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e4659-8730-4d44-be87-b78ef2a6003f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.671971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e4659-8730-4d44-be87-b78ef2a6003f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.692914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-315e4659-8730-4d44-be87-b78ef2a6003f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:22.694357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-315e4659-8730-4d44-be87-b78ef2a6003f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:22.737844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea17dd5-b56f-48d2-8945-c0c94375af1c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:22.743159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:22.743795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.744077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.744351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] PATH_INFO: `/v3/users/aeb7c8936a074fa88612189f090c1f08` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.745655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb7c8936a074fa88612189f090c1f08)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:22.747641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:22.755289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1106/2198] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:22.763558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31b265-9e0e-4a4b-8b41-a202f71c35fd None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.763869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31b265-9e0e-4a4b-8b41-a202f71c35fd None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.764140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31b265-9e0e-4a4b-8b41-a202f71c35fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.786640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-be31b265-9e0e-4a4b-8b41-a202f71c35fd None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:22.788117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-be31b265-9e0e-4a4b-8b41-a202f71c35fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:22.796453 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1107/2199] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:22.797194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb7c8936a074fa88612189f090c1f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.801208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31b265-9e0e-4a4b-8b41-a202f71c35fd None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:22.810102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb7c8936a074fa88612189f090c1f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.810425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31b265-9e0e-4a4b-8b41-a202f71c35fd None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:22.815225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:22.815856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.816134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.816404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.816650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb7c8936a074fa88612189f090c1f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.817051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:22.817508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:22.819490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:22.826984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb7c8936a074fa88612189f090c1f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.828740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb7c8936a074fa88612189f090c1f08'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:22.833881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1108/2200] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:20:22.837651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1093/2201] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:22 2022] DELETE /identity/v3/users/aeb7c8936a074fa88612189f090c1f08 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:22.838738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:22.852149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:22.870856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f4069-cf93-4a24-9e48-cf7a800e2002 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:22.956971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382330ed-4c18-420b-b88b-42655d31ab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:22.957888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382330ed-4c18-420b-b88b-42655d31ab34 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:22.958243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382330ed-4c18-420b-b88b-42655d31ab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:22.958672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382330ed-4c18-420b-b88b-42655d31ab34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:22.959424 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382330ed-4c18-420b-b88b-42655d31ab34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:22.962014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382330ed-4c18-420b-b88b-42655d31ab34 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.008205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1109/2202] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:22 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:23.011407 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.045032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383151bc-2f83-4a3a-9b27-ad8cbb845950 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.166052 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.169442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.177446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.177769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.178536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.180676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.207017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:23.224335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1094/2203] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:23 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:23.227102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382330ed-4c18-420b-b88b-42655d31ab34 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.241332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382330ed-4c18-420b-b88b-42655d31ab34 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.246134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.249672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:23.262276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c18f6-448c-4fe3-8503-b1a9222d39a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.263314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c18f6-448c-4fe3-8503-b1a9222d39a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.263717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea321c7f-4624-4ea1-b054-8ef47b4bea57 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.264289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c18f6-448c-4fe3-8503-b1a9222d39a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.265020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c18f6-448c-4fe3-8503-b1a9222d39a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.266281 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c18f6-448c-4fe3-8503-b1a9222d39a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.268579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c18f6-448c-4fe3-8503-b1a9222d39a7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.268987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.269755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.270101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.270447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] PATH_INFO: `/v3/projects/5010a8fae98b469e8cc00712b50600c3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.271757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5010a8fae98b469e8cc00712b50600c3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.273901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.282465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1110/2204] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:23.286220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c18f6-448c-4fe3-8503-b1a9222d39a7 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.299221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c18f6-448c-4fe3-8503-b1a9222d39a7 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.305417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bac032-d862-40d9-8a8f-b4744405f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.306030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bac032-d862-40d9-8a8f-b4744405f02a admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.309161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bac032-d862-40d9-8a8f-b4744405f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.309161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bac032-d862-40d9-8a8f-b4744405f02a admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.309161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bac032-d862-40d9-8a8f-b4744405f02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.309581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bac032-d862-40d9-8a8f-b4744405f02a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.313516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:23.324109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1111/2205] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:23.328331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bac032-d862-40d9-8a8f-b4744405f02a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.339684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bac032-d862-40d9-8a8f-b4744405f02a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.344740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5010a8fae98b469e8cc00712b50600c3', 'request_id': 'req-f32bf8b6-a3a0-41d1-bef2-4ba671857438'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:23.355854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5010a8fae98b469e8cc00712b50600c3', 'request_id': 'req-f32bf8b6-a3a0-41d1-bef2-4ba671857438'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:23.367663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5010a8fae98b469e8cc00712b50600c3', 'request_id': 'req-f32bf8b6-a3a0-41d1-bef2-4ba671857438'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:23.382128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] The token cache is being invalidate because project 5010a8fae98b469e8cc00712b50600c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:23.382401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:23.384011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-f32bf8b6-a3a0-41d1-bef2-4ba671857438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:23.385818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1095/2206] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:23 2022] DELETE /identity/v3/projects/5010a8fae98b469e8cc00712b50600c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:23.390299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd999-2cdc-4e35-891d-d51886b3512c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.390658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd999-2cdc-4e35-891d-d51886b3512c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.391188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabd999-2cdc-4e35-891d-d51886b3512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.413845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b050142-57c1-4b87-bd9b-4b3877e4e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.414488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ceabd999-2cdc-4e35-891d-d51886b3512c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:23.414743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050142-57c1-4b87-bd9b-4b3877e4e03c admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.415042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050142-57c1-4b87-bd9b-4b3877e4e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.415294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b050142-57c1-4b87-bd9b-4b3877e4e03c admin admin] PATH_INFO: `/v3/projects/0e60da3967ea4b898797aee63b093ff7/users/511fe90ff3074092980c3904878db8cd/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.415956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ceabd999-2cdc-4e35-891d-d51886b3512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:23.425359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1096/2207] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:23.431715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b050142-57c1-4b87-bd9b-4b3877e4e03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e60da3967ea4b898797aee63b093ff7, user_id=511fe90ff3074092980c3904878db8cd, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.433202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24965b9c-da72-4e79-8797-51d2f3ad2e12 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.433505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24965b9c-da72-4e79-8797-51d2f3ad2e12 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.433759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24965b9c-da72-4e79-8797-51d2f3ad2e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.434635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b050142-57c1-4b87-bd9b-4b3877e4e03c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.450220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1112/2208] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:23 2022] PUT /identity/v3/projects/0e60da3967ea4b898797aee63b093ff7/users/511fe90ff3074092980c3904878db8cd/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:23.455424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-24965b9c-da72-4e79-8797-51d2f3ad2e12 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:23.456645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-24965b9c-da72-4e79-8797-51d2f3ad2e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:23.460960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9779e7-99de-4bf8-9cc3-177baac87005 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.461459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9779e7-99de-4bf8-9cc3-177baac87005 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.461877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9779e7-99de-4bf8-9cc3-177baac87005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.493695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ba9779e7-99de-4bf8-9cc3-177baac87005 None None] MFA Rules not processed for user `511fe90ff3074092980c3904878db8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:23.495031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ba9779e7-99de-4bf8-9cc3-177baac87005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:23.528087 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1097/2209] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:23.532522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24965b9c-da72-4e79-8797-51d2f3ad2e12 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.542579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24965b9c-da72-4e79-8797-51d2f3ad2e12 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.547514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.548363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.548642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.548959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.549685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:23.549992 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.551619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.562156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1113/2210] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:23.564494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1098/2211] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:20:23.568757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9779e7-99de-4bf8-9cc3-177baac87005 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.578603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.580253 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9779e7-99de-4bf8-9cc3-177baac87005 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.580377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:23.584790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e937f-ac03-4fcc-8a42-82292c149902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.585518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e937f-ac03-4fcc-8a42-82292c149902 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.585794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e937f-ac03-4fcc-8a42-82292c149902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.586063 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e937f-ac03-4fcc-8a42-82292c149902 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.586709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e937f-ac03-4fcc-8a42-82292c149902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.588588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e937f-ac03-4fcc-8a42-82292c149902 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.621362 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1114/2212] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:23 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:23.626068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e937f-ac03-4fcc-8a42-82292c149902 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.653472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43e96e-0c8e-4d44-b0d1-29ee22818d20 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.666725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:23.685731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:23.701150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e937f-ac03-4fcc-8a42-82292c149902 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.705799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711da00-986a-4585-a3e7-13e257f2889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.706408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711da00-986a-4585-a3e7-13e257f2889e admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.706688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711da00-986a-4585-a3e7-13e257f2889e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.706963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711da00-986a-4585-a3e7-13e257f2889e admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.707589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711da00-986a-4585-a3e7-13e257f2889e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.708915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58750-5b03-4ffb-bf44-638d2ff4e38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.709603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711da00-986a-4585-a3e7-13e257f2889e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.709775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58750-5b03-4ffb-bf44-638d2ff4e38c service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.709959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58750-5b03-4ffb-bf44-638d2ff4e38c service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.710244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d58750-5b03-4ffb-bf44-638d2ff4e38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.732113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1115/2213] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:23 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:23.736240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711da00-986a-4585-a3e7-13e257f2889e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.746465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711da00-986a-4585-a3e7-13e257f2889e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.751040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849bcb-b8a0-4e7d-8505-2a6bce5c041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.751659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849bcb-b8a0-4e7d-8505-2a6bce5c041b admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.751940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849bcb-b8a0-4e7d-8505-2a6bce5c041b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.752216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93849bcb-b8a0-4e7d-8505-2a6bce5c041b admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.752881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849bcb-b8a0-4e7d-8505-2a6bce5c041b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.754556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93849bcb-b8a0-4e7d-8505-2a6bce5c041b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.769461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1116/2214] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:20:23.770057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d58750-5b03-4ffb-bf44-638d2ff4e38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.770057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d58750-5b03-4ffb-bf44-638d2ff4e38c service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.770492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849bcb-b8a0-4e7d-8505-2a6bce5c041b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.779725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1099/2215] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:23.781062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93849bcb-b8a0-4e7d-8505-2a6bce5c041b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.786602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad10a6-6bd7-4b66-bbb9-531c8f037ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.787403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad10a6-6bd7-4b66-bbb9-531c8f037ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.788009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad10a6-6bd7-4b66-bbb9-531c8f037ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.788092 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad10a6-6bd7-4b66-bbb9-531c8f037ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.788683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad10a6-6bd7-4b66-bbb9-531c8f037ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.790261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad10a6-6bd7-4b66-bbb9-531c8f037ae2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.800828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1117/2216] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:23.805351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58750-5b03-4ffb-bf44-638d2ff4e38c service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:23.816237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d58750-5b03-4ffb-bf44-638d2ff4e38c service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:23.821463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15acf-9225-4cae-9175-d8f87779d0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:23.822203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15acf-9225-4cae-9175-d8f87779d0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.822591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15acf-9225-4cae-9175-d8f87779d0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.822916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a15acf-9225-4cae-9175-d8f87779d0d1 admin admin] PATH_INFO: `/v3/projects/0946e002ab324286925002362779a10a/users/426430e9578e45db8eeaaf6591ecd7e2/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.841230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a15acf-9225-4cae-9175-d8f87779d0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0946e002ab324286925002362779a10a, user_id=426430e9578e45db8eeaaf6591ecd7e2, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:23.844128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a15acf-9225-4cae-9175-d8f87779d0d1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:23.857642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1100/2217] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:23 2022] PUT /identity/v3/projects/0946e002ab324286925002362779a10a/users/426430e9578e45db8eeaaf6591ecd7e2/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:23.869841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca230c-945c-44c3-85ce-4506295316ab None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:23.870306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca230c-945c-44c3-85ce-4506295316ab None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:23.870581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca230c-945c-44c3-85ce-4506295316ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:23.903020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-3cca230c-945c-44c3-85ce-4506295316ab None None] MFA Rules not processed for user `426430e9578e45db8eeaaf6591ecd7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:23.904418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3cca230c-945c-44c3-85ce-4506295316ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:23.975967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1118/2218] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:23.980823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15acf-9225-4cae-9175-d8f87779d0d1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:24.050259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a15acf-9225-4cae-9175-d8f87779d0d1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:24.055267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f8ee-a2f3-4047-9dda-4133c297fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:24.055926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f8ee-a2f3-4047-9dda-4133c297fb9b admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.056204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f8ee-a2f3-4047-9dda-4133c297fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.056471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6f8ee-a2f3-4047-9dda-4133c297fb9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.057128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6f8ee-a2f3-4047-9dda-4133c297fb9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:24.059225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6f8ee-a2f3-4047-9dda-4133c297fb9b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:24.093303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1101/2219] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:23 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:24.095608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca230c-945c-44c3-85ce-4506295316ab None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:24.111951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca230c-945c-44c3-85ce-4506295316ab None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:24.169813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362203a-07bb-4dc6-93b1-b3b13ba8ae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:24.170435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362203a-07bb-4dc6-93b1-b3b13ba8ae28 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.170715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362203a-07bb-4dc6-93b1-b3b13ba8ae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.170981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362203a-07bb-4dc6-93b1-b3b13ba8ae28 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.171616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362203a-07bb-4dc6-93b1-b3b13ba8ae28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:24.173638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362203a-07bb-4dc6-93b1-b3b13ba8ae28 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:24.197762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1119/2220] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:24 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:24.201930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f8ee-a2f3-4047-9dda-4133c297fb9b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:24.212949 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6f8ee-a2f3-4047-9dda-4133c297fb9b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:24.217986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b40dd1-a769-4cf7-9646-2bf7a2777eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:24.218624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40dd1-a769-4cf7-9646-2bf7a2777eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.218840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40dd1-a769-4cf7-9646-2bf7a2777eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.219096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40dd1-a769-4cf7-9646-2bf7a2777eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.219779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b40dd1-a769-4cf7-9646-2bf7a2777eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:24.221492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b40dd1-a769-4cf7-9646-2bf7a2777eaf admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:24.236382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1102/2221] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:24.237275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362203a-07bb-4dc6-93b1-b3b13ba8ae28 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:24.251475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362203a-07bb-4dc6-93b1-b3b13ba8ae28 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:24.257460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2debd-c079-4f68-97a6-96c7adbbbe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:24.258153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2debd-c079-4f68-97a6-96c7adbbbe51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.258570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2debd-c079-4f68-97a6-96c7adbbbe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.258901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2debd-c079-4f68-97a6-96c7adbbbe51 admin admin] PATH_INFO: `/v3/projects/99f179bda1f0406a8582b918c442b195/users/5626c63fc1194493b22a7a7aab284d1e/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.275619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2debd-c079-4f68-97a6-96c7adbbbe51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f179bda1f0406a8582b918c442b195, user_id=5626c63fc1194493b22a7a7aab284d1e, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:24.278607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2debd-c079-4f68-97a6-96c7adbbbe51 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:24.295186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1120/2222] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:24 2022] PUT /identity/v3/projects/99f179bda1f0406a8582b918c442b195/users/5626c63fc1194493b22a7a7aab284d1e/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:24.299322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b40dd1-a769-4cf7-9646-2bf7a2777eaf admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:24.309601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b40dd1-a769-4cf7-9646-2bf7a2777eaf admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:24.327081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:24.381398 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a8ab5-6407-4359-ad8a-5c211e464abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:24.382027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8ab5-6407-4359-ad8a-5c211e464abb admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.382295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8ab5-6407-4359-ad8a-5c211e464abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.382565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a8ab5-6407-4359-ad8a-5c211e464abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.383220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a8ab5-6407-4359-ad8a-5c211e464abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:24.384820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a8ab5-6407-4359-ad8a-5c211e464abb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:24.395088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1103/2223] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:24.399829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2debd-c079-4f68-97a6-96c7adbbbe51 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:24.410974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2debd-c079-4f68-97a6-96c7adbbbe51 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:24.415854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46984b-15da-4cb5-b3a5-55b072e75b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:24.416516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46984b-15da-4cb5-b3a5-55b072e75b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.416793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46984b-15da-4cb5-b3a5-55b072e75b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.417061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46984b-15da-4cb5-b3a5-55b072e75b98 admin admin] PATH_INFO: `/v3/projects/99f179bda1f0406a8582b918c442b195/users/5626c63fc1194493b22a7a7aab284d1e/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.419000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46984b-15da-4cb5-b3a5-55b072e75b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f179bda1f0406a8582b918c442b195, user_id=5626c63fc1194493b22a7a7aab284d1e, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:24.421638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46984b-15da-4cb5-b3a5-55b072e75b98 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:24.428188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:24.434547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1121/2224] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:24 2022] PUT /identity/v3/projects/99f179bda1f0406a8582b918c442b195/users/5626c63fc1194493b22a7a7aab284d1e/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:24.445570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc910-b29d-4a3e-bc1a-0be01681028e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.445974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc910-b29d-4a3e-bc1a-0be01681028e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.446297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc910-b29d-4a3e-bc1a-0be01681028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.474026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-542dc910-b29d-4a3e-bc1a-0be01681028e None None] MFA Rules not processed for user `5626c63fc1194493b22a7a7aab284d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:24.475495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-542dc910-b29d-4a3e-bc1a-0be01681028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:24.550958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1104/2225] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:24.563079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46984b-15da-4cb5-b3a5-55b072e75b98 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:24.621338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46984b-15da-4cb5-b3a5-55b072e75b98 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:24.627869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e72a23-e052-4ef0-b3ac-f07bbe11e6e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:24.628808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e72a23-e052-4ef0-b3ac-f07bbe11e6e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.629265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e72a23-e052-4ef0-b3ac-f07bbe11e6e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.629597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e72a23-e052-4ef0-b3ac-f07bbe11e6e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.639997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e72a23-e052-4ef0-b3ac-f07bbe11e6e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:24.641580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e72a23-e052-4ef0-b3ac-f07bbe11e6e0 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:24.652882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1122/2226] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:24.758092 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc910-b29d-4a3e-bc1a-0be01681028e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:24.768825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dc910-b29d-4a3e-bc1a-0be01681028e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:24.773277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d2338-154c-4325-b151-9111b1299618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:24.773866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2338-154c-4325-b151-9111b1299618 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:24.774142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2338-154c-4325-b151-9111b1299618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:24.774409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d2338-154c-4325-b151-9111b1299618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:24.833909 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d2338-154c-4325-b151-9111b1299618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:24.835377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d2338-154c-4325-b151-9111b1299618 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:24.844335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1105/2227] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:27.482349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e72a23-e052-4ef0-b3ac-f07bbe11e6e0 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:27.550538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e72a23-e052-4ef0-b3ac-f07bbe11e6e0 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:27.555272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:27.555906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:27.556191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:27.556458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] PATH_INFO: `/v3/users/426430e9578e45db8eeaaf6591ecd7e2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:27.557630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426430e9578e45db8eeaaf6591ecd7e2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:27.559545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:27.608418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426430e9578e45db8eeaaf6591ecd7e2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:27.609071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426430e9578e45db8eeaaf6591ecd7e2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:27.622326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426430e9578e45db8eeaaf6591ecd7e2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:27.635258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426430e9578e45db8eeaaf6591ecd7e2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:27.653390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426430e9578e45db8eeaaf6591ecd7e2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:27.661016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1123/2228] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:27 2022] DELETE /identity/v3/users/426430e9578e45db8eeaaf6591ecd7e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:27.665893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d543-41de-4842-87cc-dbaafa76408e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:27.666392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d543-41de-4842-87cc-dbaafa76408e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:27.666475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7d543-41de-4842-87cc-dbaafa76408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:27.688437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8ae7d543-41de-4842-87cc-dbaafa76408e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:27.689696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8ae7d543-41de-4842-87cc-dbaafa76408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:27.727627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:27.758102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1106/2229] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:27.767953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:27.769426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:27.792126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:27.838217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd8c32-b67a-4c24-a0da-264d6ed8fe18 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:27.843209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a51ff3-6021-444e-93f6-1079e53a5d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:27.843912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51ff3-6021-444e-93f6-1079e53a5d9b service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:27.844382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51ff3-6021-444e-93f6-1079e53a5d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:27.844742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a51ff3-6021-444e-93f6-1079e53a5d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:27.855834 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a51ff3-6021-444e-93f6-1079e53a5d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:27.857286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a51ff3-6021-444e-93f6-1079e53a5d9b service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:27.867074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1124/2230] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:28.346772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7d543-41de-4842-87cc-dbaafa76408e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:28.348501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8ae7d543-41de-4842-87cc-dbaafa76408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:28.373738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7d543-41de-4842-87cc-dbaafa76408e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:28.381445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:28.392371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:28.392731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:28.393013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] PATH_INFO: `/v3/projects/0946e002ab324286925002362779a10a` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:28.395015 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0946e002ab324286925002362779a10a)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:28.397378 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:28.467020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0946e002ab324286925002362779a10a', 'request_id': 'req-01400331-b38a-4390-8174-7bdaff7d350c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.475605 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0946e002ab324286925002362779a10a', 'request_id': 'req-01400331-b38a-4390-8174-7bdaff7d350c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.482934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0946e002ab324286925002362779a10a', 'request_id': 'req-01400331-b38a-4390-8174-7bdaff7d350c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.497377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] The token cache is being invalidate because project 0946e002ab324286925002362779a10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:28.497377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.498028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.512944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1107/2231] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:28 2022] DELETE /identity/v3/projects/0946e002ab324286925002362779a10a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:28.516924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a51ff3-6021-444e-93f6-1079e53a5d9b service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:28.528932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a51ff3-6021-444e-93f6-1079e53a5d9b service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:28.634628 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:28.635383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:28.635727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:28.636332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] PATH_INFO: `/v3/users/5626c63fc1194493b22a7a7aab284d1e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:28.650153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5626c63fc1194493b22a7a7aab284d1e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:28.653211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:28.721017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5626c63fc1194493b22a7a7aab284d1e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.721824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5626c63fc1194493b22a7a7aab284d1e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.735469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5626c63fc1194493b22a7a7aab284d1e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.742931 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5626c63fc1194493b22a7a7aab284d1e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.752573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-fa250efc-d56b-443d-a28f-53c394c91505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5626c63fc1194493b22a7a7aab284d1e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:28.759851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1125/2232] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:28 2022] DELETE /identity/v3/users/5626c63fc1194493b22a7a7aab284d1e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:29.057703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.059265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:29.074002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01400331-b38a-4390-8174-7bdaff7d350c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.133372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.134011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.134287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.134586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] PATH_INFO: `/v3/projects/99f179bda1f0406a8582b918c442b195` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.135749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f179bda1f0406a8582b918c442b195)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.137705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.184951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f179bda1f0406a8582b918c442b195', 'request_id': 'req-3719651a-e10c-4260-909a-1f9f9cdc62fd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.193176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f179bda1f0406a8582b918c442b195', 'request_id': 'req-3719651a-e10c-4260-909a-1f9f9cdc62fd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.198794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f179bda1f0406a8582b918c442b195', 'request_id': 'req-3719651a-e10c-4260-909a-1f9f9cdc62fd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.199917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:29.212057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] The token cache is being invalidate because project 99f179bda1f0406a8582b918c442b195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:29.212353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.212981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.214497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1108/2233] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:29 2022] DELETE /identity/v3/projects/99f179bda1f0406a8582b918c442b195 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:29.219511 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e71f-d96b-47c6-aafa-24ed26b3f558 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.219793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e71f-d96b-47c6-aafa-24ed26b3f558 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.220066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e71f-d96b-47c6-aafa-24ed26b3f558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.240530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-37d9e71f-d96b-47c6-aafa-24ed26b3f558 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:29.241844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-37d9e71f-d96b-47c6-aafa-24ed26b3f558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:29.289805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:29.302684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.304709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:29.328826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1126/2234] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:29.338016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8d35-5739-4379-aace-9ac1ae4b730d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.339014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8d35-5739-4379-aace-9ac1ae4b730d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.339238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b8d35-5739-4379-aace-9ac1ae4b730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.378185 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9e9b8d35-5739-4379-aace-9ac1ae4b730d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:29.380048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9e9b8d35-5739-4379-aace-9ac1ae4b730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:29.390856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1127/2235] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:29.395537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b8d35-5739-4379-aace-9ac1ae4b730d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.398045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719651a-e10c-4260-909a-1f9f9cdc62fd admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.406119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.406895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.407237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.407608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] PATH_INFO: `/v3/users/511fe90ff3074092980c3904878db8cd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.408932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=511fe90ff3074092980c3904878db8cd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.410485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b8d35-5739-4379-aace-9ac1ae4b730d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.411184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.418783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.419522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.420555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.420555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.421053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:29.421887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.423524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.437934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1128/2236] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:20:29.443175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.457150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30588fb7-38b4-41f8-85f4-2499a55a01e6 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.464674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d4b26-6bee-4384-ba4b-4ea217bfd814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.465779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d4b26-6bee-4384-ba4b-4ea217bfd814 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.465935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d4b26-6bee-4384-ba4b-4ea217bfd814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.466166 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d4b26-6bee-4384-ba4b-4ea217bfd814 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.466836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d4b26-6bee-4384-ba4b-4ea217bfd814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.468739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d4b26-6bee-4384-ba4b-4ea217bfd814 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.482170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511fe90ff3074092980c3904878db8cd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.497920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511fe90ff3074092980c3904878db8cd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.505570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1129/2237] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:29 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:29.506702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d4b26-6bee-4384-ba4b-4ea217bfd814 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.511918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511fe90ff3074092980c3904878db8cd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.521650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511fe90ff3074092980c3904878db8cd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.522487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-db36668a-85b9-420b-9faa-98618546cbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511fe90ff3074092980c3904878db8cd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:29.532381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1109/2238] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:29 2022] DELETE /identity/v3/users/511fe90ff3074092980c3904878db8cd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:29.539761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d160ce0-ea7a-447c-9f80-12b12b864b48 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.540138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d160ce0-ea7a-447c-9f80-12b12b864b48 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.540541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d160ce0-ea7a-447c-9f80-12b12b864b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.560530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7d160ce0-ea7a-447c-9f80-12b12b864b48 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:29.561766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7d160ce0-ea7a-447c-9f80-12b12b864b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:29.573781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d4b26-6bee-4384-ba4b-4ea217bfd814 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.643324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1110/2239] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:29.646390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.647738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.647738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.647927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.648476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.650363 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.654120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d160ce0-ea7a-447c-9f80-12b12b864b48 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.655668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7d160ce0-ea7a-447c-9f80-12b12b864b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:29.671496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:29.680723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1130/2240] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:29 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:29.681967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.685331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:29.699388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f8250-d2c7-48cd-b63f-fe72fbfb5f25 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.721433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea5216-c611-4fe7-987e-e9ba1e551340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.722082 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea5216-c611-4fe7-987e-e9ba1e551340 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.722541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea5216-c611-4fe7-987e-e9ba1e551340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.722821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea5216-c611-4fe7-987e-e9ba1e551340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.723482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea5216-c611-4fe7-987e-e9ba1e551340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.725186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea5216-c611-4fe7-987e-e9ba1e551340 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.737978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d160ce0-ea7a-447c-9f80-12b12b864b48 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.742498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1131/2241] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:29.743912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea5216-c611-4fe7-987e-e9ba1e551340 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.748656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b75330-abb2-41db-89c0-bfb5fdeed50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.751714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b75330-abb2-41db-89c0-bfb5fdeed50c service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.752006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b75330-abb2-41db-89c0-bfb5fdeed50c service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.752286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b75330-abb2-41db-89c0-bfb5fdeed50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.757576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea5216-c611-4fe7-987e-e9ba1e551340 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.770797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09500c-c0e0-4b72-97dd-28e09a1b5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.772339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09500c-c0e0-4b72-97dd-28e09a1b5e98 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.772864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09500c-c0e0-4b72-97dd-28e09a1b5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.773561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b75330-abb2-41db-89c0-bfb5fdeed50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.773882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09500c-c0e0-4b72-97dd-28e09a1b5e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.774858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09500c-c0e0-4b72-97dd-28e09a1b5e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.775406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b75330-abb2-41db-89c0-bfb5fdeed50c service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.780182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09500c-c0e0-4b72-97dd-28e09a1b5e98 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.786981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1111/2242] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:29.799520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1132/2243] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:29.804320 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b75330-abb2-41db-89c0-bfb5fdeed50c service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:29.819747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b75330-abb2-41db-89c0-bfb5fdeed50c service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:29.825189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f131bc-fc28-4df3-8cd4-54cfad2a310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:29.825865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f131bc-fc28-4df3-8cd4-54cfad2a310b admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.826145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f131bc-fc28-4df3-8cd4-54cfad2a310b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.826420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f131bc-fc28-4df3-8cd4-54cfad2a310b admin admin] PATH_INFO: `/v3/projects/4be0649ddc384ad99c8c2631749634b0/users/d2648df5c5b94923a3bf7fa1a829aa28/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.869914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f131bc-fc28-4df3-8cd4-54cfad2a310b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be0649ddc384ad99c8c2631749634b0, user_id=d2648df5c5b94923a3bf7fa1a829aa28, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:29.872702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f131bc-fc28-4df3-8cd4-54cfad2a310b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:29.905606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1112/2244] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:29 2022] PUT /identity/v3/projects/4be0649ddc384ad99c8c2631749634b0/users/d2648df5c5b94923a3bf7fa1a829aa28/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:29.917043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbcdd-f095-4bf5-b627-99a9c407fdbb None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:29.917979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbcdd-f095-4bf5-b627-99a9c407fdbb None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:29.918277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acbcdd-f095-4bf5-b627-99a9c407fdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:29.965953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-98acbcdd-f095-4bf5-b627-99a9c407fdbb None None] MFA Rules not processed for user `d2648df5c5b94923a3bf7fa1a829aa28`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:29.967254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-98acbcdd-f095-4bf5-b627-99a9c407fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:29.971403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:30.061159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1133/2245] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:30.066410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f131bc-fc28-4df3-8cd4-54cfad2a310b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.139323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f131bc-fc28-4df3-8cd4-54cfad2a310b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.147259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e548fd1-d087-4557-b8ef-184518e318fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.147259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548fd1-d087-4557-b8ef-184518e318fd admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.147259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548fd1-d087-4557-b8ef-184518e318fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.147259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548fd1-d087-4557-b8ef-184518e318fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.147643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e548fd1-d087-4557-b8ef-184518e318fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.149198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acbcdd-f095-4bf5-b627-99a9c407fdbb None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.149384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e548fd1-d087-4557-b8ef-184518e318fd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.151118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-98acbcdd-f095-4bf5-b627-99a9c407fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:30.175333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acbcdd-f095-4bf5-b627-99a9c407fdbb None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.182181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.183162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.183652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.184124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] PATH_INFO: `/v3/projects/0e60da3967ea4b898797aee63b093ff7` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.184318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1113/2246] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:30 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:30.185855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e60da3967ea4b898797aee63b093ff7)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.188460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e548fd1-d087-4557-b8ef-184518e318fd admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.188745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.268561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e60da3967ea4b898797aee63b093ff7', 'request_id': 'req-4d9646dd-0576-487f-aa1f-2833258861ba'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:30.279894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e60da3967ea4b898797aee63b093ff7', 'request_id': 'req-4d9646dd-0576-487f-aa1f-2833258861ba'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:30.295082 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e60da3967ea4b898797aee63b093ff7', 'request_id': 'req-4d9646dd-0576-487f-aa1f-2833258861ba'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:30.306284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e548fd1-d087-4557-b8ef-184518e318fd admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.320313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] The token cache is being invalidate because project 0e60da3967ea4b898797aee63b093ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:30.321113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:30.322638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-4d9646dd-0576-487f-aa1f-2833258861ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:30.325649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1134/2247] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:30 2022] DELETE /identity/v3/projects/0e60da3967ea4b898797aee63b093ff7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:30.330226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3752-f74d-4f32-9a4c-7faa0fd1b06a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.330689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3752-f74d-4f32-9a4c-7faa0fd1b06a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.331115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced3752-f74d-4f32-9a4c-7faa0fd1b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.348594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:30.368445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-2ced3752-f74d-4f32-9a4c-7faa0fd1b06a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:30.369814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2ced3752-f74d-4f32-9a4c-7faa0fd1b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:30.402156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.402790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.403074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.403348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.403996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.407654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.432703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1114/2248] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:30 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:30.436720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.438607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:30.445597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1135/2249] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:30.454728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0349f0-3943-43ed-910f-40778c0a074b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.456050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0349f0-3943-43ed-910f-40778c0a074b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.456390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0349f0-3943-43ed-910f-40778c0a074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.459692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c6f02-4682-4023-ae96-a45bbd4421cc admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.469057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87271152-13e3-4f79-8100-2d06249ebcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.469727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271152-13e3-4f79-8100-2d06249ebcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.470026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271152-13e3-4f79-8100-2d06249ebcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.470291 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87271152-13e3-4f79-8100-2d06249ebcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.470993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87271152-13e3-4f79-8100-2d06249ebcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.472609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87271152-13e3-4f79-8100-2d06249ebcb2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.486604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ba0349f0-3943-43ed-910f-40778c0a074b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:30.488681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ba0349f0-3943-43ed-910f-40778c0a074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:30.502114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1115/2250] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:20:30.503029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1136/2251] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:30.503226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87271152-13e3-4f79-8100-2d06249ebcb2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.507090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0349f0-3943-43ed-910f-40778c0a074b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.514570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87271152-13e3-4f79-8100-2d06249ebcb2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.519763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1425e-81d9-422e-8d5c-01db45b0aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.520533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1425e-81d9-422e-8d5c-01db45b0aa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.520926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1425e-81d9-422e-8d5c-01db45b0aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.521328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1425e-81d9-422e-8d5c-01db45b0aa14 admin admin] PATH_INFO: `/v3/projects/8150922ec71348ee9689f3fa9fc40934/users/73f8f87333ce497898bea35bce5ba5a7/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.535083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0349f0-3943-43ed-910f-40778c0a074b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.544762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.545458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.547193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1425e-81d9-422e-8d5c-01db45b0aa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8150922ec71348ee9689f3fa9fc40934, user_id=73f8f87333ce497898bea35bce5ba5a7, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.547322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.547630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.548246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:30.549226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.551096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.552039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1425e-81d9-422e-8d5c-01db45b0aa14 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.573914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1116/2252] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:30 2022] PUT /identity/v3/projects/8150922ec71348ee9689f3fa9fc40934/users/73f8f87333ce497898bea35bce5ba5a7/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:30.575100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1425e-81d9-422e-8d5c-01db45b0aa14 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.587204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1137/2253] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:20:30.594255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.614644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad75dfe-b502-4513-b636-61587c235723 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.631642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:30.726343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1425e-81d9-422e-8d5c-01db45b0aa14 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.730640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227127e-234e-4e84-8558-fb61aeea6c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.733818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c28437-cde6-4e51-a14b-e7c5afc7a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.735083 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28437-cde6-4e51-a14b-e7c5afc7a046 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.735460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28437-cde6-4e51-a14b-e7c5afc7a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.735797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c28437-cde6-4e51-a14b-e7c5afc7a046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.736606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c28437-cde6-4e51-a14b-e7c5afc7a046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.737208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227127e-234e-4e84-8558-fb61aeea6c65 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.737887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227127e-234e-4e84-8558-fb61aeea6c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.738213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227127e-234e-4e84-8558-fb61aeea6c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.738787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c28437-cde6-4e51-a14b-e7c5afc7a046 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.738898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227127e-234e-4e84-8558-fb61aeea6c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.740996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227127e-234e-4e84-8558-fb61aeea6c65 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.767761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1117/2254] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:30.770711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c28437-cde6-4e51-a14b-e7c5afc7a046 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.775429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1138/2255] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:30 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:30.779766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227127e-234e-4e84-8558-fb61aeea6c65 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.782525 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c28437-cde6-4e51-a14b-e7c5afc7a046 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.840520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b989f5-0d9b-45a9-af5c-efd72bdb3385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.841231 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b989f5-0d9b-45a9-af5c-efd72bdb3385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.841516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b989f5-0d9b-45a9-af5c-efd72bdb3385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.841805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b989f5-0d9b-45a9-af5c-efd72bdb3385 admin admin] PATH_INFO: `/v3/projects/8150922ec71348ee9689f3fa9fc40934/users/73f8f87333ce497898bea35bce5ba5a7/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.843862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b989f5-0d9b-45a9-af5c-efd72bdb3385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8150922ec71348ee9689f3fa9fc40934, user_id=73f8f87333ce497898bea35bce5ba5a7, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.844593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227127e-234e-4e84-8558-fb61aeea6c65 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.846809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b989f5-0d9b-45a9-af5c-efd72bdb3385 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.849561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655684cf-fa13-4c0c-87f5-beef82bc23a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.850335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655684cf-fa13-4c0c-87f5-beef82bc23a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.850673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655684cf-fa13-4c0c-87f5-beef82bc23a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.851009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655684cf-fa13-4c0c-87f5-beef82bc23a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.851765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655684cf-fa13-4c0c-87f5-beef82bc23a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.853689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655684cf-fa13-4c0c-87f5-beef82bc23a2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:30.858308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1118/2256] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:30 2022] PUT /identity/v3/projects/8150922ec71348ee9689f3fa9fc40934/users/73f8f87333ce497898bea35bce5ba5a7/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:30.869195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043fbbc-e770-4c7a-9655-bc3d02109e56 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.869535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043fbbc-e770-4c7a-9655-bc3d02109e56 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.869793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043fbbc-e770-4c7a-9655-bc3d02109e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.883616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1139/2257] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:30 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:30.887654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655684cf-fa13-4c0c-87f5-beef82bc23a2 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:30.895013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:30.898358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655684cf-fa13-4c0c-87f5-beef82bc23a2 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:30.909362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6043fbbc-e770-4c7a-9655-bc3d02109e56 None None] MFA Rules not processed for user `73f8f87333ce497898bea35bce5ba5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:30.910749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6043fbbc-e770-4c7a-9655-bc3d02109e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:30.975410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff7c77-5c77-4f5b-93b4-6e074e9d7422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:30.976046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff7c77-5c77-4f5b-93b4-6e074e9d7422 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:30.976383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff7c77-5c77-4f5b-93b4-6e074e9d7422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:30.976667 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff7c77-5c77-4f5b-93b4-6e074e9d7422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:30.977361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff7c77-5c77-4f5b-93b4-6e074e9d7422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:30.979183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff7c77-5c77-4f5b-93b4-6e074e9d7422 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:31.003684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1140/2258] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:20:31.004977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff7c77-5c77-4f5b-93b4-6e074e9d7422 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:31.018131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff7c77-5c77-4f5b-93b4-6e074e9d7422 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:31.021044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1119/2259] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:31.024233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:31.024965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:31.025283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:31.025553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:31.026513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:31.028091 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:31.044851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1141/2260] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:31.046673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043fbbc-e770-4c7a-9655-bc3d02109e56 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:31.058690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043fbbc-e770-4c7a-9655-bc3d02109e56 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:31.063670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166fd69-e7ec-4bf6-80a7-441358dc24f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:31.064439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fd69-e7ec-4bf6-80a7-441358dc24f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:31.064784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fd69-e7ec-4bf6-80a7-441358dc24f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:31.065209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fd69-e7ec-4bf6-80a7-441358dc24f1 admin admin] PATH_INFO: `/v3/projects/4edf42e65dda4658ab15301fa8cf53e6/users/639b22dd051b48869eb621422cbd1f51/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:31.082993 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166fd69-e7ec-4bf6-80a7-441358dc24f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edf42e65dda4658ab15301fa8cf53e6, user_id=639b22dd051b48869eb621422cbd1f51, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:31.085828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166fd69-e7ec-4bf6-80a7-441358dc24f1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:31.108237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:31.111751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:31.115068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1120/2261] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:31 2022] PUT /identity/v3/projects/4edf42e65dda4658ab15301fa8cf53e6/users/639b22dd051b48869eb621422cbd1f51/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:31.125632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad007-8077-4388-93f6-ad86aec433e2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:31.125997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad007-8077-4388-93f6-ad86aec433e2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:31.126730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad007-8077-4388-93f6-ad86aec433e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:31.131094 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:31.158182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ab1ad007-8077-4388-93f6-ad86aec433e2 None None] MFA Rules not processed for user `639b22dd051b48869eb621422cbd1f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:31.159566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ab1ad007-8077-4388-93f6-ad86aec433e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:31.199524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97e5b-7e49-4c13-9279-f5ad1a5a9385 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:31.240677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1121/2262] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:31.255803 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ad007-8077-4388-93f6-ad86aec433e2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:31.258701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ab1ad007-8077-4388-93f6-ad86aec433e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:31.262491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af4307-197f-4619-9d27-8c331fdb366a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:31.263160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af4307-197f-4619-9d27-8c331fdb366a service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:31.263445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af4307-197f-4619-9d27-8c331fdb366a service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:31.263716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af4307-197f-4619-9d27-8c331fdb366a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:31.265850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f2af4307-197f-4619-9d27-8c331fdb366a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:31.332414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ad007-8077-4388-93f6-ad86aec433e2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:31.336558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af4307-197f-4619-9d27-8c331fdb366a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:31.338207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af4307-197f-4619-9d27-8c331fdb366a service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:31.338895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f45db0ea864a3299cccd7a74b7271b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:31.339675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:31.340054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:31.340588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:31.349474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1142/2263] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:31.357425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:31.358928 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:31.369172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1122/2264] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:31.613010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463959ca-aaa2-47e2-b60e-3889e6866a63 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:31.613551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463959ca-aaa2-47e2-b60e-3889e6866a63 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:31.613677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463959ca-aaa2-47e2-b60e-3889e6866a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:31.634162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-463959ca-aaa2-47e2-b60e-3889e6866a63 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:31.635418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-463959ca-aaa2-47e2-b60e-3889e6866a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:31.713734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1143/2265] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:20:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:31.791160 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:31.793049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:31.800147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:31.892765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c717965-8811-46cf-98cb-1308834ce681 service glance] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:31.902129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:31.902835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:31.903551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:31.903846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:31.915672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:31.917562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:31.928756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1123/2266] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:20:35.893302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463959ca-aaa2-47e2-b60e-3889e6866a63 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:35.913764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463959ca-aaa2-47e2-b60e-3889e6866a63 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:35.927909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94f16-37b1-41de-b0e8-74dc6278eecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:35.928917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94f16-37b1-41de-b0e8-74dc6278eecf service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:35.929385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94f16-37b1-41de-b0e8-74dc6278eecf service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:35.929822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94f16-37b1-41de-b0e8-74dc6278eecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:35.967355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:35.998878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:36.001056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:36.016704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94f16-37b1-41de-b0e8-74dc6278eecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:36.017923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94f16-37b1-41de-b0e8-74dc6278eecf service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:36.030102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1144/2267] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:36.119963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561033a-195e-4153-af29-8bfed092ab92 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:36.125053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:36.125785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:36.126070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:36.126347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] PATH_INFO: `/v3/users/0eecd16cc21b493db3a0f462c30ef75a` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:36.127735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eecd16cc21b493db3a0f462c30ef75a)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:36.130451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:36.229917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eecd16cc21b493db3a0f462c30ef75a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:36.270947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eecd16cc21b493db3a0f462c30ef75a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:36.282740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eecd16cc21b493db3a0f462c30ef75a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:36.296948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eecd16cc21b493db3a0f462c30ef75a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:36.297901 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eecd16cc21b493db3a0f462c30ef75a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:36.306679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1124/2268] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:35 2022] DELETE /identity/v3/users/0eecd16cc21b493db3a0f462c30ef75a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:36.313701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4496bd-6f01-491e-90a8-bded6bf8a4e3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:36.314488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4496bd-6f01-491e-90a8-bded6bf8a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:36.314971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4496bd-6f01-491e-90a8-bded6bf8a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:36.349647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4b4496bd-6f01-491e-90a8-bded6bf8a4e3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:36.351440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4b4496bd-6f01-491e-90a8-bded6bf8a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:36.449825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1145/2269] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:36.461571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:36.463864 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:36.487125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:36.669534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9259b3-1fcf-4d5a-9c46-8c5c18675260 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:36.682122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3602e-b986-4d41-8b4d-5bbd7528484e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:36.684523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3602e-b986-4d41-8b4d-5bbd7528484e service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:36.684957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3602e-b986-4d41-8b4d-5bbd7528484e service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:36.685504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3602e-b986-4d41-8b4d-5bbd7528484e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:36.705386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3602e-b986-4d41-8b4d-5bbd7528484e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:36.707282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3602e-b986-4d41-8b4d-5bbd7528484e service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:36.725716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1125/2270] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:37.275450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4496bd-6f01-491e-90a8-bded6bf8a4e3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:37.277786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4b4496bd-6f01-491e-90a8-bded6bf8a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:37.303142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4496bd-6f01-491e-90a8-bded6bf8a4e3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:37.310312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:37.311790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:37.312051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:37.312426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] PATH_INFO: `/v3/projects/e1f423fe291048058e38ae4c297b7732` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:37.314170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f423fe291048058e38ae4c297b7732)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:37.316380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:37.374815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f423fe291048058e38ae4c297b7732', 'request_id': 'req-796a524e-9725-4a69-864d-43ecdd69b794'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:37.380848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f423fe291048058e38ae4c297b7732', 'request_id': 'req-796a524e-9725-4a69-864d-43ecdd69b794'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:37.388896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f423fe291048058e38ae4c297b7732', 'request_id': 'req-796a524e-9725-4a69-864d-43ecdd69b794'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:37.412351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] The token cache is being invalidate because project e1f423fe291048058e38ae4c297b7732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:37.412616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:37.413374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:37.415382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1146/2271] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:37 2022] DELETE /identity/v3/projects/e1f423fe291048058e38ae4c297b7732 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:39.498905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8263e8-4de2-4744-a735-a378a0eeb680 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:39.499487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8263e8-4de2-4744-a735-a378a0eeb680 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:39.499487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8263e8-4de2-4744-a735-a378a0eeb680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:39.520286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6a8263e8-4de2-4744-a735-a378a0eeb680 None None] MFA Rules not processed for user `359f2e7aebf74167bf87af802bccdbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:39.521623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6a8263e8-4de2-4744-a735-a378a0eeb680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:39.587232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1126/2272] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:41.484298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:41.486262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:41.542437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:41.564818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a524e-9725-4a69-864d-43ecdd69b794 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:41.569931 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:41.570569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:41.570852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:41.571124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] PATH_INFO: `/v3/users/d2648df5c5b94923a3bf7fa1a829aa28` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:41.573582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2648df5c5b94923a3bf7fa1a829aa28)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:41.575852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:41.634390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2648df5c5b94923a3bf7fa1a829aa28'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:41.635232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2648df5c5b94923a3bf7fa1a829aa28'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:41.649114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2648df5c5b94923a3bf7fa1a829aa28'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:41.657275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2648df5c5b94923a3bf7fa1a829aa28'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:41.667677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2648df5c5b94923a3bf7fa1a829aa28'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:41.674773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1147/2273] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:41 2022] DELETE /identity/v3/users/d2648df5c5b94923a3bf7fa1a829aa28 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:41.680570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df823969-c948-4935-8b5a-d68963b8bbf8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:41.681212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df823969-c948-4935-8b5a-d68963b8bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:41.681212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df823969-c948-4935-8b5a-d68963b8bbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:41.704384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-df823969-c948-4935-8b5a-d68963b8bbf8 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:41.705763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-df823969-c948-4935-8b5a-d68963b8bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:41.769774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1127/2274] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:41.781131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:41.782783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:41.851433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986df9c4-c81b-4546-a114-09d4fccd9e6f admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:41.855578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d504-3a72-479d-8fb3-0d2974621027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:41.856356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d504-3a72-479d-8fb3-0d2974621027 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:41.856633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d504-3a72-479d-8fb3-0d2974621027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:41.856985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d504-3a72-479d-8fb3-0d2974621027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:41.867372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61d504-3a72-479d-8fb3-0d2974621027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:41.868983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61d504-3a72-479d-8fb3-0d2974621027 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:41.880365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1148/2275] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:20:42.196855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df823969-c948-4935-8b5a-d68963b8bbf8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:42.198584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-df823969-c948-4935-8b5a-d68963b8bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:42.213971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df823969-c948-4935-8b5a-d68963b8bbf8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:42.218828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:42.219496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:42.219772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:42.220046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] PATH_INFO: `/v3/projects/4be0649ddc384ad99c8c2631749634b0` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:42.221395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be0649ddc384ad99c8c2631749634b0)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:42.223371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:42.287294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be0649ddc384ad99c8c2631749634b0', 'request_id': 'req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.291812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:42.298370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be0649ddc384ad99c8c2631749634b0', 'request_id': 'req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.306195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be0649ddc384ad99c8c2631749634b0', 'request_id': 'req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.318521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] The token cache is being invalidate because project 4be0649ddc384ad99c8c2631749634b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:42.319011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.319679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.324261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1128/2276] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:42 2022] DELETE /identity/v3/projects/4be0649ddc384ad99c8c2631749634b0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:42.325531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d504-3a72-479d-8fb3-0d2974621027 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:42.336240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d504-3a72-479d-8fb3-0d2974621027 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:42.397368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:42.398165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:42.398538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:42.398897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] PATH_INFO: `/v3/users/73f8f87333ce497898bea35bce5ba5a7` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:42.400134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f8f87333ce497898bea35bce5ba5a7)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:42.402596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:42.407725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:42.465206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f8f87333ce497898bea35bce5ba5a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.465746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f8f87333ce497898bea35bce5ba5a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.480192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f8f87333ce497898bea35bce5ba5a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.488302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f8f87333ce497898bea35bce5ba5a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.499999 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-db539164-1bce-40ba-870a-c5ae756eb8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f8f87333ce497898bea35bce5ba5a7'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:42.509816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1149/2277] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:42 2022] DELETE /identity/v3/users/73f8f87333ce497898bea35bce5ba5a7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:43.113767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:43.116064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:43.131601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f4f34-b41f-474f-a6a0-9313e446ab4a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:43.212568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:43.213328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.213719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.213998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] PATH_INFO: `/v3/projects/8150922ec71348ee9689f3fa9fc40934` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.215234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8150922ec71348ee9689f3fa9fc40934)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:43.217366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:43.296488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8150922ec71348ee9689f3fa9fc40934', 'request_id': 'req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:43.308558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8150922ec71348ee9689f3fa9fc40934', 'request_id': 'req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:43.317168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8150922ec71348ee9689f3fa9fc40934', 'request_id': 'req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:43.329852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] The token cache is being invalidate because project 8150922ec71348ee9689f3fa9fc40934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:43.330152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:43.330800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2dea472f-23c8-4ba4-b0db-0fa86fb140c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:43.332312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1129/2278] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:43 2022] DELETE /identity/v3/projects/8150922ec71348ee9689f3fa9fc40934 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:43.338937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70e90-67a7-404b-916c-021f3214cba0 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.339302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70e90-67a7-404b-916c-021f3214cba0 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.339651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70e90-67a7-404b-916c-021f3214cba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.364519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-01a70e90-67a7-404b-916c-021f3214cba0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:43.366002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-01a70e90-67a7-404b-916c-021f3214cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:43.442228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1150/2279] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:43.444495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a27b-0ca6-4d3b-b7fd-98ededee861f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.444781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a27b-0ca6-4d3b-b7fd-98ededee861f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.445056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a27b-0ca6-4d3b-b7fd-98ededee861f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.469652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-94e6a27b-0ca6-4d3b-b7fd-98ededee861f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:43.470894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-94e6a27b-0ca6-4d3b-b7fd-98ededee861f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:43.479739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1130/2280] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:43.484233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a70e90-67a7-404b-916c-021f3214cba0 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:43.495409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a70e90-67a7-404b-916c-021f3214cba0 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:43.500443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:43.501215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.501558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.501827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.502483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:43.502786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:43.504365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:43.517708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1151/2281] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:20:43.522610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6a27b-0ca6-4d3b-b7fd-98ededee861f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:43.537385 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6a27b-0ca6-4d3b-b7fd-98ededee861f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:43.549728 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80605fa-f973-4071-94fd-dd453d1e23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:43.550369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80605fa-f973-4071-94fd-dd453d1e23c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.550802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80605fa-f973-4071-94fd-dd453d1e23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.551074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80605fa-f973-4071-94fd-dd453d1e23c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.551907 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80605fa-f973-4071-94fd-dd453d1e23c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:43.553951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80605fa-f973-4071-94fd-dd453d1e23c0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:43.589531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1131/2282] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:43 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:43.590277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:43.602486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc9339-0207-44b2-ada9-7107b2e9234e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:43.671914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970b22c-892f-4c75-b65a-5de10406c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:43.672740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970b22c-892f-4c75-b65a-5de10406c5fb admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.673021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970b22c-892f-4c75-b65a-5de10406c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.673903 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970b22c-892f-4c75-b65a-5de10406c5fb admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.674573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970b22c-892f-4c75-b65a-5de10406c5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:43.676747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970b22c-892f-4c75-b65a-5de10406c5fb admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:43.695988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:43.706828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80605fa-f973-4071-94fd-dd453d1e23c0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:43.708250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1152/2283] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:43 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:43.719391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80605fa-f973-4071-94fd-dd453d1e23c0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:43.724963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f16faf-6e01-4024-83cd-3fb7bbf821f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:43.725951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16faf-6e01-4024-83cd-3fb7bbf821f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.726459 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16faf-6e01-4024-83cd-3fb7bbf821f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.726897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f16faf-6e01-4024-83cd-3fb7bbf821f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.727622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f16faf-6e01-4024-83cd-3fb7bbf821f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:43.729375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f16faf-6e01-4024-83cd-3fb7bbf821f9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:43.740598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1132/2284] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:43.744681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970b22c-892f-4c75-b65a-5de10406c5fb admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:43.757380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970b22c-892f-4c75-b65a-5de10406c5fb admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:43.763418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba6c8-ad31-4667-ba30-b2a09d4ae1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:43.764202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba6c8-ad31-4667-ba30-b2a09d4ae1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.764988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba6c8-ad31-4667-ba30-b2a09d4ae1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.765429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba6c8-ad31-4667-ba30-b2a09d4ae1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.766367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba6c8-ad31-4667-ba30-b2a09d4ae1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:43.768184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba6c8-ad31-4667-ba30-b2a09d4ae1e7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:43.786934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1153/2285] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:43.788554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f16faf-6e01-4024-83cd-3fb7bbf821f9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:43.804784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f16faf-6e01-4024-83cd-3fb7bbf821f9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:43.811403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:43.812352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.812833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.813132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] PATH_INFO: `/v3/projects/cb1c59300b1a4f1c9c601c294e549812/users/51cf1140a8644fba83068098c55ff6b0/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.833246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1c59300b1a4f1c9c601c294e549812, user_id=51cf1140a8644fba83068098c55ff6b0, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:43.837489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:43.854106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1133/2286] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:43 2022] PUT /identity/v3/projects/cb1c59300b1a4f1c9c601c294e549812/users/51cf1140a8644fba83068098c55ff6b0/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:43.868650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67178-c712-4f7e-8085-5bb5c67e18b1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:43.868935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67178-c712-4f7e-8085-5bb5c67e18b1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:43.869295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67178-c712-4f7e-8085-5bb5c67e18b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:43.906785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ffe67178-c712-4f7e-8085-5bb5c67e18b1 None None] MFA Rules not processed for user `51cf1140a8644fba83068098c55ff6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:43.908205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ffe67178-c712-4f7e-8085-5bb5c67e18b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:43.984604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1154/2287] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:43.996016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:43.997984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:44.014848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:44.079468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd0c8e-48ad-45fa-9bbc-804b6ec4b82c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:44.085180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95724135-70c5-4cdf-b94c-4bb84ca5f369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:44.085845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724135-70c5-4cdf-b94c-4bb84ca5f369 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:44.086004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724135-70c5-4cdf-b94c-4bb84ca5f369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:44.086364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95724135-70c5-4cdf-b94c-4bb84ca5f369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:44.102722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95724135-70c5-4cdf-b94c-4bb84ca5f369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:44.104216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95724135-70c5-4cdf-b94c-4bb84ca5f369 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:44.114102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1134/2288] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:47.296182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67178-c712-4f7e-8085-5bb5c67e18b1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:47.368971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67178-c712-4f7e-8085-5bb5c67e18b1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:47.374090 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:47.374735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:47.375013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:47.375323 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] PATH_INFO: `/v3/users/51cf1140a8644fba83068098c55ff6b0` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:47.376668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cf1140a8644fba83068098c55ff6b0)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:47.378643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:47.439375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cf1140a8644fba83068098c55ff6b0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:47.440055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cf1140a8644fba83068098c55ff6b0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:47.456145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cf1140a8644fba83068098c55ff6b0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:47.464354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cf1140a8644fba83068098c55ff6b0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:47.474178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cf1140a8644fba83068098c55ff6b0'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:47.476222 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:47.482208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1155/2289] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:20:47 2022] DELETE /identity/v3/users/51cf1140a8644fba83068098c55ff6b0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:47.487343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb873b0-8434-4956-9000-6da5b2ffd86a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:47.488961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb873b0-8434-4956-9000-6da5b2ffd86a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:47.489487 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb873b0-8434-4956-9000-6da5b2ffd86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:47.510481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3eb873b0-8434-4956-9000-6da5b2ffd86a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:47.511975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3eb873b0-8434-4956-9000-6da5b2ffd86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:47.581133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1135/2290] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:47.588792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:47.590384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:47.667431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4150c-fc11-49f5-9a6c-72232a85d045 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:47.683772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4353-1714-4737-861f-0a51110dd7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:47.684571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4353-1714-4737-861f-0a51110dd7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:47.684856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4353-1714-4737-861f-0a51110dd7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:47.685423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4353-1714-4737-861f-0a51110dd7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:47.696962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b4353-1714-4737-861f-0a51110dd7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:47.698475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b4353-1714-4737-861f-0a51110dd7f2 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:47.710959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1156/2291] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:48.069266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb873b0-8434-4956-9000-6da5b2ffd86a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:48.071359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3eb873b0-8434-4956-9000-6da5b2ffd86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:48.090630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb873b0-8434-4956-9000-6da5b2ffd86a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:48.095572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:48.096226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.096498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.096776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] PATH_INFO: `/v3/projects/cb1c59300b1a4f1c9c601c294e549812` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.098244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1c59300b1a4f1c9c601c294e549812)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:48.100704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:48.164026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1c59300b1a4f1c9c601c294e549812', 'request_id': 'req-84c7ba91-7cd2-42e2-b075-62a463853cda'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:48.187626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1c59300b1a4f1c9c601c294e549812', 'request_id': 'req-84c7ba91-7cd2-42e2-b075-62a463853cda'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:48.197338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1c59300b1a4f1c9c601c294e549812', 'request_id': 'req-84c7ba91-7cd2-42e2-b075-62a463853cda'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:48.211747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] The token cache is being invalidate because project cb1c59300b1a4f1c9c601c294e549812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:20:48.211941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:48.212640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-84c7ba91-7cd2-42e2-b075-62a463853cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:20:48.215099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1136/2292] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:20:48 2022] DELETE /identity/v3/projects/cb1c59300b1a4f1c9c601c294e549812 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:20:48.219927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793cac4-6bb2-4bdd-b826-ddbfbb725926 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.220218 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793cac4-6bb2-4bdd-b826-ddbfbb725926 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.220597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793cac4-6bb2-4bdd-b826-ddbfbb725926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.250684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7793cac4-6bb2-4bdd-b826-ddbfbb725926 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:48.254188 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7793cac4-6bb2-4bdd-b826-ddbfbb725926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:48.340645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1157/2293] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:48.349028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936999-e7f7-4f17-af49-5c53976e556b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.349661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936999-e7f7-4f17-af49-5c53976e556b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.350277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00936999-e7f7-4f17-af49-5c53976e556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.373380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-00936999-e7f7-4f17-af49-5c53976e556b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:48.374621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-00936999-e7f7-4f17-af49-5c53976e556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:48.386713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1137/2294] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:48.388039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793cac4-6bb2-4bdd-b826-ddbfbb725926 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:48.399587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793cac4-6bb2-4bdd-b826-ddbfbb725926 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:48.405143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:48.405780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.406081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.406442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.407352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:20:48.407563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:48.409465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:48.430782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1158/2295] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:20:48.432276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936999-e7f7-4f17-af49-5c53976e556b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:48.448030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00936999-e7f7-4f17-af49-5c53976e556b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:48.453749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbff2e0-7ba4-459f-af82-c62cf0800dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:48.454406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbff2e0-7ba4-459f-af82-c62cf0800dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.454738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbff2e0-7ba4-459f-af82-c62cf0800dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.455148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbff2e0-7ba4-459f-af82-c62cf0800dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.455811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbff2e0-7ba4-459f-af82-c62cf0800dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:48.458661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbff2e0-7ba4-459f-af82-c62cf0800dd5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:48.497146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1138/2296] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:20:48 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:20:48.497996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:48.509749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d36670-5348-465c-9927-4d8eb0dc55ab admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:48.576783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07250c6-a8ad-4bb0-a7cf-22a01eaff484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:48.577467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07250c6-a8ad-4bb0-a7cf-22a01eaff484 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.577744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07250c6-a8ad-4bb0-a7cf-22a01eaff484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.578136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07250c6-a8ad-4bb0-a7cf-22a01eaff484 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.578813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07250c6-a8ad-4bb0-a7cf-22a01eaff484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:48.580703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07250c6-a8ad-4bb0-a7cf-22a01eaff484 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:48.609629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1159/2297] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:20:48 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:20:48.610964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbff2e0-7ba4-459f-af82-c62cf0800dd5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:48.624509 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbff2e0-7ba4-459f-af82-c62cf0800dd5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:48.633508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d5879-319e-4f2e-b448-89166eda8b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:48.634134 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d5879-319e-4f2e-b448-89166eda8b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.634415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d5879-319e-4f2e-b448-89166eda8b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.634683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d5879-319e-4f2e-b448-89166eda8b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.635338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d5879-319e-4f2e-b448-89166eda8b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:48.636937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d5879-319e-4f2e-b448-89166eda8b57 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:48.638513 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:48.654307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1139/2298] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:48.655592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07250c6-a8ad-4bb0-a7cf-22a01eaff484 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:48.666592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07250c6-a8ad-4bb0-a7cf-22a01eaff484 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:48.671789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1e22d-2411-44d0-ab76-075e36ebc07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:48.672537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e22d-2411-44d0-ab76-075e36ebc07e admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.672669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e22d-2411-44d0-ab76-075e36ebc07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.672936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1e22d-2411-44d0-ab76-075e36ebc07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.673621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1e22d-2411-44d0-ab76-075e36ebc07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:48.675305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1e22d-2411-44d0-ab76-075e36ebc07e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:48.687560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1160/2299] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:20:48.694814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d5879-319e-4f2e-b448-89166eda8b57 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:48.706591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d5879-319e-4f2e-b448-89166eda8b57 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:48.713228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:48.714446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.714956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.715419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] PATH_INFO: `/v3/projects/cd0d30e36ff448d0a7b4f2421aecbb53/users/0c856bf416124086a06fc3b8365310ff/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.735481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0d30e36ff448d0a7b4f2421aecbb53, user_id=0c856bf416124086a06fc3b8365310ff, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:48.738417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:48.756154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1140/2300] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:20:48 2022] PUT /identity/v3/projects/cd0d30e36ff448d0a7b4f2421aecbb53/users/0c856bf416124086a06fc3b8365310ff/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:20:48.767799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427bfd4-e1c4-40c9-8d32-2251e5dec254 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.768081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427bfd4-e1c4-40c9-8d32-2251e5dec254 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.768350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427bfd4-e1c4-40c9-8d32-2251e5dec254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.782752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:20:48.799960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-5427bfd4-e1c4-40c9-8d32-2251e5dec254 None None] MFA Rules not processed for user `0c856bf416124086a06fc3b8365310ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:48.801244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5427bfd4-e1c4-40c9-8d32-2251e5dec254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:48.876717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1161/2301] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:48.886404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:48.888424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:48.951066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d387e-e902-45ac-ba46-5e031c0b7bac admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:48.955476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ff9d3-ea4c-46fe-ab32-b699a6612013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:48.956107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ff9d3-ea4c-46fe-ab32-b699a6612013 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:48.956401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ff9d3-ea4c-46fe-ab32-b699a6612013 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:48.956675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ff9d3-ea4c-46fe-ab32-b699a6612013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:48.965914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ff9d3-ea4c-46fe-ab32-b699a6612013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:48.967373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ff9d3-ea4c-46fe-ab32-b699a6612013 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:48.976976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1141/2302] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:20:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:20:54.877976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676a030-b88f-47b8-b5de-4c6b1528761f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:54.878636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676a030-b88f-47b8-b5de-4c6b1528761f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:54.878802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676a030-b88f-47b8-b5de-4c6b1528761f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:54.903746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-c676a030-b88f-47b8-b5de-4c6b1528761f None None] MFA Rules not processed for user `9032773d56f84e7c889b189b21803c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:54.905111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c676a030-b88f-47b8-b5de-4c6b1528761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:54.988199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1162/2303] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:20:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:20:58.772925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86956-e3ed-4b4e-8981-f71ee6d5f5e4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:58.773537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86956-e3ed-4b4e-8981-f71ee6d5f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:58.773652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff86956-e3ed-4b4e-8981-f71ee6d5f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:58.795123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4ff86956-e3ed-4b4e-8981-f71ee6d5f5e4 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:20:58.796385 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4ff86956-e3ed-4b4e-8981-f71ee6d5f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:58.858439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1142/2304] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 31 05:20:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:20:58.872459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676a030-b88f-47b8-b5de-4c6b1528761f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:20:58.874058 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c676a030-b88f-47b8-b5de-4c6b1528761f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:20:58.947489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676a030-b88f-47b8-b5de-4c6b1528761f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:20:58.954023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a466c1c-5906-4f7b-9329-ceaff589398d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:20:58.954562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466c1c-5906-4f7b-9329-ceaff589398d service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:20:58.954896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466c1c-5906-4f7b-9329-ceaff589398d service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:20:58.955174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a466c1c-5906-4f7b-9329-ceaff589398d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:20:58.966397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466c1c-5906-4f7b-9329-ceaff589398d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:20:58.968075 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a466c1c-5906-4f7b-9329-ceaff589398d service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:20:58.978033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1163/2305] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:20:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:00.271520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86956-e3ed-4b4e-8981-f71ee6d5f5e4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:00.338135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff86956-e3ed-4b4e-8981-f71ee6d5f5e4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:00.342953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:00.343597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:00.343867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:00.344135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] PATH_INFO: `/v3/users/0c856bf416124086a06fc3b8365310ff` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:00.345313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c856bf416124086a06fc3b8365310ff)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:00.347215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:00.370001 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:00.399148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c856bf416124086a06fc3b8365310ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:00.412497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c856bf416124086a06fc3b8365310ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:00.419578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c856bf416124086a06fc3b8365310ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:00.428882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c856bf416124086a06fc3b8365310ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:00.429839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c856bf416124086a06fc3b8365310ff'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:00.435715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1143/2306] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:21:00 2022] DELETE /identity/v3/users/0c856bf416124086a06fc3b8365310ff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:00.440055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fae0c-206b-4866-b200-d743c4b82cc1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:00.440594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fae0c-206b-4866-b200-d743c4b82cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:00.440594 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fae0c-206b-4866-b200-d743c4b82cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:00.460107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-6c4fae0c-206b-4866-b200-d743c4b82cc1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:00.461364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6c4fae0c-206b-4866-b200-d743c4b82cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:00.489019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:00.523457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1164/2307] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:00.533639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:00.535091 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:00.593557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00915ed2-fb3c-45bd-81f5-9318ed0d381c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:00.598405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:00.599041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:00.599325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:00.599601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:00.610078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:00.611591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:00.626365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1144/2308] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:01.103215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fae0c-206b-4866-b200-d743c4b82cc1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:01.105673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6c4fae0c-206b-4866-b200-d743c4b82cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:01.121135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fae0c-206b-4866-b200-d743c4b82cc1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:01.126446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:01.127296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:01.127780 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:01.128198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] PATH_INFO: `/v3/projects/cd0d30e36ff448d0a7b4f2421aecbb53` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:01.132033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0d30e36ff448d0a7b4f2421aecbb53)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:01.134200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:01.254824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0d30e36ff448d0a7b4f2421aecbb53', 'request_id': 'req-adfb99c2-93f2-47b7-9d07-621d48b15a77'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.274018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0d30e36ff448d0a7b4f2421aecbb53', 'request_id': 'req-adfb99c2-93f2-47b7-9d07-621d48b15a77'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.282269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0d30e36ff448d0a7b4f2421aecbb53', 'request_id': 'req-adfb99c2-93f2-47b7-9d07-621d48b15a77'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.307557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] The token cache is being invalidate because project cd0d30e36ff448d0a7b4f2421aecbb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:21:01.307855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.310227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.312226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1165/2309] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:21:01 2022] DELETE /identity/v3/projects/cd0d30e36ff448d0a7b4f2421aecbb53 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:01.398489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:01.400125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:01.430420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10688f35-2cb1-4cd6-ad56-eb8afdcd9fb6 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:01.513972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:01.515343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:01.515905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:01.516332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] PATH_INFO: `/v3/users/df1a5792ffa94afd813c3f0f526890af` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:01.518635 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1a5792ffa94afd813c3f0f526890af)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:01.522064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:01.579547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:01.582055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1a5792ffa94afd813c3f0f526890af'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.601894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1a5792ffa94afd813c3f0f526890af'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.615126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1a5792ffa94afd813c3f0f526890af'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.627046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1a5792ffa94afd813c3f0f526890af'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.627679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a8925c4d-52ff-4466-8576-d0b83d971f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1a5792ffa94afd813c3f0f526890af'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:01.637170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1145/2310] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:21:01 2022] DELETE /identity/v3/users/df1a5792ffa94afd813c3f0f526890af => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:21:01.868055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:01.869616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:01.882841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb99c2-93f2-47b7-9d07-621d48b15a77 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:01.947832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:01.948545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:01.948897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:01.949265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] PATH_INFO: `/v3/projects/9fa05c463af24c69ad7bf9a2d5f76a6e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:01.950619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa05c463af24c69ad7bf9a2d5f76a6e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:01.957927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:02.015208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa05c463af24c69ad7bf9a2d5f76a6e', 'request_id': 'req-6462a2c4-fcc1-444a-b988-3b18d483fc3a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:02.021158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:02.023370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa05c463af24c69ad7bf9a2d5f76a6e', 'request_id': 'req-6462a2c4-fcc1-444a-b988-3b18d483fc3a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:02.034291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa05c463af24c69ad7bf9a2d5f76a6e', 'request_id': 'req-6462a2c4-fcc1-444a-b988-3b18d483fc3a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:02.058340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] The token cache is being invalidate because project 9fa05c463af24c69ad7bf9a2d5f76a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:21:02.058843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:02.059539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6462a2c4-fcc1-444a-b988-3b18d483fc3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:02.068170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec455f4d-89d4-4a90-8bed-228dad701ad4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.068514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec455f4d-89d4-4a90-8bed-228dad701ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.068827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec455f4d-89d4-4a90-8bed-228dad701ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.072420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1166/2311] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:21:01 2022] DELETE /identity/v3/projects/9fa05c463af24c69ad7bf9a2d5f76a6e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:02.095311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ec455f4d-89d4-4a90-8bed-228dad701ad4 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:02.096574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ec455f4d-89d4-4a90-8bed-228dad701ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:02.187629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1146/2312] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:02.196374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27ee5d-9cce-4aeb-b5f4-0ab1f2f7c923 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.196728 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27ee5d-9cce-4aeb-b5f4-0ab1f2f7c923 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.197041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27ee5d-9cce-4aeb-b5f4-0ab1f2f7c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.222258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-3c27ee5d-9cce-4aeb-b5f4-0ab1f2f7c923 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:02.223623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3c27ee5d-9cce-4aeb-b5f4-0ab1f2f7c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:02.237915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1167/2313] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:02.239150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec455f4d-89d4-4a90-8bed-228dad701ad4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:02.250920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec455f4d-89d4-4a90-8bed-228dad701ad4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:02.256878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:02.257680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.258126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.258413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.259201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:21:02.259514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:02.261245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:02.279207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1147/2314] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:21:02.284028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27ee5d-9cce-4aeb-b5f4-0ab1f2f7c923 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:02.296085 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27ee5d-9cce-4aeb-b5f4-0ab1f2f7c923 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:02.302117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de93f6-83bd-4da0-a316-28951b67bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:02.302943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de93f6-83bd-4da0-a316-28951b67bc7e admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.303192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de93f6-83bd-4da0-a316-28951b67bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.303711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de93f6-83bd-4da0-a316-28951b67bc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.304446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de93f6-83bd-4da0-a316-28951b67bc7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:02.306567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de93f6-83bd-4da0-a316-28951b67bc7e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:02.341389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1168/2315] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:21:02 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:21:02.345582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:02.356356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafe093-c3dd-4dc4-a161-ac1494bc5337 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:02.427099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f8726-891d-4d77-9992-2a94cc09be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:02.428439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f8726-891d-4d77-9992-2a94cc09be39 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.428715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f8726-891d-4d77-9992-2a94cc09be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.428983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f8726-891d-4d77-9992-2a94cc09be39 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.429691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f8726-891d-4d77-9992-2a94cc09be39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:02.431746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f8726-891d-4d77-9992-2a94cc09be39 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:02.456674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1148/2316] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:21:02 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:21:02.458039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de93f6-83bd-4da0-a316-28951b67bc7e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:02.473102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de93f6-83bd-4da0-a316-28951b67bc7e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:02.479286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ededd-9bf6-4491-8333-5794566c188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:02.480201 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ededd-9bf6-4491-8333-5794566c188c admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.481123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ededd-9bf6-4491-8333-5794566c188c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.481123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ededd-9bf6-4491-8333-5794566c188c admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.481752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ededd-9bf6-4491-8333-5794566c188c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:02.483483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ededd-9bf6-4491-8333-5794566c188c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:02.497724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1169/2317] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:21:02.499940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f8726-891d-4d77-9992-2a94cc09be39 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:02.515732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f8726-891d-4d77-9992-2a94cc09be39 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:02.522870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf510427-a718-450e-bdac-4c5a49505036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:02.523826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf510427-a718-450e-bdac-4c5a49505036 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.524223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf510427-a718-450e-bdac-4c5a49505036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.524604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf510427-a718-450e-bdac-4c5a49505036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.525751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf510427-a718-450e-bdac-4c5a49505036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:02.528638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf510427-a718-450e-bdac-4c5a49505036 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:02.544352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1149/2318] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:21:02.549207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ededd-9bf6-4491-8333-5794566c188c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:02.562811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ededd-9bf6-4491-8333-5794566c188c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:02.567721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:02.568457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.569928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.570202 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] PATH_INFO: `/v3/projects/39d956e557d94fc3ad04d5815e5a75c7/users/0bccf285a3b54cf6baacaa0c81b7823c/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.588573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d956e557d94fc3ad04d5815e5a75c7, user_id=0bccf285a3b54cf6baacaa0c81b7823c, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:02.591305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:02.607270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1170/2319] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:21:02 2022] PUT /identity/v3/projects/39d956e557d94fc3ad04d5815e5a75c7/users/0bccf285a3b54cf6baacaa0c81b7823c/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:02.618447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c10a0-262d-458d-a831-7ca80cfec5a6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.618857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c10a0-262d-458d-a831-7ca80cfec5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.619195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c10a0-262d-458d-a831-7ca80cfec5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.648739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-470c10a0-262d-458d-a831-7ca80cfec5a6 None None] MFA Rules not processed for user `0bccf285a3b54cf6baacaa0c81b7823c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:02.649908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-470c10a0-262d-458d-a831-7ca80cfec5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:02.663720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:02.716759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1150/2320] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:02.728933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:02.731030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:02.792217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163668-217f-4c34-95b0-3b88bac8ece7 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:02.796860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b99f17-3d5e-4f6f-8df6-4714e43a17bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:02.797577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b99f17-3d5e-4f6f-8df6-4714e43a17bf service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:02.797857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b99f17-3d5e-4f6f-8df6-4714e43a17bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:02.798125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b99f17-3d5e-4f6f-8df6-4714e43a17bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:02.808131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b99f17-3d5e-4f6f-8df6-4714e43a17bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:02.809646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b99f17-3d5e-4f6f-8df6-4714e43a17bf service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:02.819369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1171/2321] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:04.451376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c10a0-262d-458d-a831-7ca80cfec5a6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:04.452992 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-470c10a0-262d-458d-a831-7ca80cfec5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:04.540247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c10a0-262d-458d-a831-7ca80cfec5a6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:04.545394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:04.546188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:04.546384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:04.546622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] PATH_INFO: `/v3/users/639b22dd051b48869eb621422cbd1f51` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:04.547813 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=639b22dd051b48869eb621422cbd1f51)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:04.549814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:04.601682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639b22dd051b48869eb621422cbd1f51'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:04.615275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639b22dd051b48869eb621422cbd1f51'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:04.623222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639b22dd051b48869eb621422cbd1f51'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:04.634843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639b22dd051b48869eb621422cbd1f51'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:04.636225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639b22dd051b48869eb621422cbd1f51'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:04.642355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1151/2322] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:21:04 2022] DELETE /identity/v3/users/639b22dd051b48869eb621422cbd1f51 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:04.647243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a77d0-0d18-4989-9112-dbde94c717d3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:04.647722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a77d0-0d18-4989-9112-dbde94c717d3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:04.647837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a77d0-0d18-4989-9112-dbde94c717d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:04.668177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9b7a77d0-0d18-4989-9112-dbde94c717d3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:04.669418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9b7a77d0-0d18-4989-9112-dbde94c717d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:04.767085 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1172/2323] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:04.779653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:04.781210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:04.838671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:04.861380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64699a2e-c337-4562-87fe-df3303e7a76f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:04.864945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0836d-c520-4e94-b617-b755d5a82fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:04.865703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0836d-c520-4e94-b617-b755d5a82fef service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:04.866128 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0836d-c520-4e94-b617-b755d5a82fef service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:04.866417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0836d-c520-4e94-b617-b755d5a82fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:04.876065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0836d-c520-4e94-b617-b755d5a82fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:04.877555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0836d-c520-4e94-b617-b755d5a82fef service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:04.888339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1152/2324] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:05.208939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a77d0-0d18-4989-9112-dbde94c717d3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.211260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9b7a77d0-0d18-4989-9112-dbde94c717d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:05.233272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a77d0-0d18-4989-9112-dbde94c717d3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.239841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.240989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.241367 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.241703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] PATH_INFO: `/v3/projects/4edf42e65dda4658ab15301fa8cf53e6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.243208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edf42e65dda4658ab15301fa8cf53e6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:05.245264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:05.281579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:05.313634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edf42e65dda4658ab15301fa8cf53e6', 'request_id': 'req-79df7c04-17c2-43e6-a662-f7365c00cfeb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.319709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edf42e65dda4658ab15301fa8cf53e6', 'request_id': 'req-79df7c04-17c2-43e6-a662-f7365c00cfeb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.327198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edf42e65dda4658ab15301fa8cf53e6', 'request_id': 'req-79df7c04-17c2-43e6-a662-f7365c00cfeb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.343770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] The token cache is being invalidate because project 4edf42e65dda4658ab15301fa8cf53e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:21:05.344022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.344652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.349770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1173/2325] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:21:05 2022] DELETE /identity/v3/projects/4edf42e65dda4658ab15301fa8cf53e6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:05.351797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc981e-07da-4b40-a423-c8680fba80f6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.352148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc981e-07da-4b40-a423-c8680fba80f6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.352882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc981e-07da-4b40-a423-c8680fba80f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.374833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-39bc981e-07da-4b40-a423-c8680fba80f6 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:05.376244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-39bc981e-07da-4b40-a423-c8680fba80f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:05.444479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.446689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:05.469126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1153/2326] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:05.478474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132374f-0635-4f71-913b-4eca7b1f5f8a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.478847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132374f-0635-4f71-913b-4eca7b1f5f8a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.479198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132374f-0635-4f71-913b-4eca7b1f5f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.525253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b132374f-0635-4f71-913b-4eca7b1f5f8a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:05.528556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b132374f-0635-4f71-913b-4eca7b1f5f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:05.531111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df7c04-17c2-43e6-a662-f7365c00cfeb admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.537224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.538259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.538259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.538966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] PATH_INFO: `/v3/users/0bccf285a3b54cf6baacaa0c81b7823c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.539908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bccf285a3b54cf6baacaa0c81b7823c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:05.541904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:05.548371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1154/2327] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:05.551294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132374f-0635-4f71-913b-4eca7b1f5f8a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.562319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132374f-0635-4f71-913b-4eca7b1f5f8a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.567485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.568229 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.568668 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.569039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.569881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:21:05.570402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:05.572156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:05.596254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1155/2328] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:21:05.600960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.614894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bccf285a3b54cf6baacaa0c81b7823c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.620500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bccf285a3b54cf6baacaa0c81b7823c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.625809 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cceb8-abab-49e7-bacf-9e09d8ccc810 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.636020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.636669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.636943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.637246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.637931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:05.639888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bccf285a3b54cf6baacaa0c81b7823c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.640027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:05.649587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bccf285a3b54cf6baacaa0c81b7823c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.668378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-551248aa-2714-4081-ae08-5f734edf7de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bccf285a3b54cf6baacaa0c81b7823c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:05.680347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1156/2329] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:21:05 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:21:05.681743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.684346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:05.686299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1174/2330] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:21:05 2022] DELETE /identity/v3/users/0bccf285a3b54cf6baacaa0c81b7823c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:21:05.692138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323a74b-ce11-4acf-84de-093f2fcbd817 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.692532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323a74b-ce11-4acf-84de-093f2fcbd817 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.693559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323a74b-ce11-4acf-84de-093f2fcbd817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.722730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7323a74b-ce11-4acf-84de-093f2fcbd817 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:05.724360 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7323a74b-ce11-4acf-84de-093f2fcbd817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:05.760480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:05.767073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ccd5-ee83-4613-a5b4-89452475bddb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.815176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1175/2331] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:21:05.826658 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:05.830484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323a74b-ce11-4acf-84de-093f2fcbd817 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.832159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7323a74b-ce11-4acf-84de-093f2fcbd817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:05.844660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1ca5-afd7-4d4a-89ef-d235c4da44a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.845265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1ca5-afd7-4d4a-89ef-d235c4da44a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.845541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1ca5-afd7-4d4a-89ef-d235c4da44a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.845807 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a1ca5-afd7-4d4a-89ef-d235c4da44a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.846440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1ca5-afd7-4d4a-89ef-d235c4da44a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:05.848376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a1ca5-afd7-4d4a-89ef-d235c4da44a5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:05.872855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1157/2332] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:21:05 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:21:05.877461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1ca5-afd7-4d4a-89ef-d235c4da44a5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.887669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a1ca5-afd7-4d4a-89ef-d235c4da44a5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.892195 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3522a-0807-444b-937e-363aaac9c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.892825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3522a-0807-444b-937e-363aaac9c8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.893112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3522a-0807-444b-937e-363aaac9c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.893317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323a74b-ce11-4acf-84de-093f2fcbd817 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.893425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3522a-0807-444b-937e-363aaac9c8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.894023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3522a-0807-444b-937e-363aaac9c8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:05.895670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3522a-0807-444b-937e-363aaac9c8b4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:05.897150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630659dc-a860-4503-888b-a26c7ab71009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.897765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630659dc-a860-4503-888b-a26c7ab71009 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.898043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630659dc-a860-4503-888b-a26c7ab71009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.898320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630659dc-a860-4503-888b-a26c7ab71009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.906351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1158/2333] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:21:05.910474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3522a-0807-444b-937e-363aaac9c8b4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.911948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630659dc-a860-4503-888b-a26c7ab71009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:05.913536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630659dc-a860-4503-888b-a26c7ab71009 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:05.921638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3522a-0807-444b-937e-363aaac9c8b4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.926582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1176/2334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:21:05.927232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472ecee-428e-426c-b5b2-1adcabc2e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.927975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ecee-428e-426c-b5b2-1adcabc2e975 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.928265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ecee-428e-426c-b5b2-1adcabc2e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.928543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472ecee-428e-426c-b5b2-1adcabc2e975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:05.929349 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472ecee-428e-426c-b5b2-1adcabc2e975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:05.931055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472ecee-428e-426c-b5b2-1adcabc2e975 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:05.946839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1159/2335] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:21:05.950830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630659dc-a860-4503-888b-a26c7ab71009 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:05.961942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630659dc-a860-4503-888b-a26c7ab71009 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:05.967298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:05.969591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:05.969869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:05.970140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] PATH_INFO: `/v3/projects/87e0fc51a1fe483bb8f0fa22b47071d9/users/84ccab5497bc46f7934d27ea7f9f244d/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.007053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e0fc51a1fe483bb8f0fa22b47071d9, user_id=84ccab5497bc46f7934d27ea7f9f244d, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.017445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.050324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1177/2336] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:21:05 2022] PUT /identity/v3/projects/87e0fc51a1fe483bb8f0fa22b47071d9/users/84ccab5497bc46f7934d27ea7f9f244d/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:06.053421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240ce0-d842-4b96-9d4b-847873376588 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.053805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240ce0-d842-4b96-9d4b-847873376588 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.054141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8240ce0-d842-4b96-9d4b-847873376588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.092614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b8240ce0-d842-4b96-9d4b-847873376588 None None] MFA Rules not processed for user `84ccab5497bc46f7934d27ea7f9f244d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:06.094271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b8240ce0-d842-4b96-9d4b-847873376588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:06.193283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1160/2337] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:06.205206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:06.208680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:06.274744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb9f1-141c-4ac5-9841-a89e7398fd6d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:06.278927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279df13-6b37-4c97-b167-bcd73fd7f19f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:06.279605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279df13-6b37-4c97-b167-bcd73fd7f19f service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.279885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279df13-6b37-4c97-b167-bcd73fd7f19f service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.280150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279df13-6b37-4c97-b167-bcd73fd7f19f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.289644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279df13-6b37-4c97-b167-bcd73fd7f19f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.291910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240ce0-d842-4b96-9d4b-847873376588 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:06.293323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b8240ce0-d842-4b96-9d4b-847873376588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:06.293674 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279df13-6b37-4c97-b167-bcd73fd7f19f service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.313541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1178/2338] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:06.363328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8240ce0-d842-4b96-9d4b-847873376588 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:06.369496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:06.370141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.370423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.370702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] PATH_INFO: `/v3/projects/39d956e557d94fc3ad04d5815e5a75c7` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.371889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d956e557d94fc3ad04d5815e5a75c7)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.373839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.419782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:06.424025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d956e557d94fc3ad04d5815e5a75c7', 'request_id': 'req-2d9843bc-ab05-4275-9490-fe5d9043172e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:06.432937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d956e557d94fc3ad04d5815e5a75c7', 'request_id': 'req-2d9843bc-ab05-4275-9490-fe5d9043172e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:06.439897 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d956e557d94fc3ad04d5815e5a75c7', 'request_id': 'req-2d9843bc-ab05-4275-9490-fe5d9043172e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:06.452328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] The token cache is being invalidate because project 39d956e557d94fc3ad04d5815e5a75c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:21:06.452731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:06.453545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2d9843bc-ab05-4275-9490-fe5d9043172e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:06.455655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1161/2339] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:21:06 2022] DELETE /identity/v3/projects/39d956e557d94fc3ad04d5815e5a75c7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:21:06.462047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbe09-35d9-418d-aad3-d02918feb468 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.462414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbe09-35d9-418d-aad3-d02918feb468 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.462778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbe09-35d9-418d-aad3-d02918feb468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.485458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-31efbe09-35d9-418d-aad3-d02918feb468 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:06.486397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-31efbe09-35d9-418d-aad3-d02918feb468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:06.535524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:06.552769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1179/2340] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:06.560629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78405e-d1f9-4d6e-be4a-7c70153caedc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.561103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78405e-d1f9-4d6e-be4a-7c70153caedc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.561219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78405e-d1f9-4d6e-be4a-7c70153caedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.585753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0f78405e-d1f9-4d6e-be4a-7c70153caedc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:06.586988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0f78405e-d1f9-4d6e-be4a-7c70153caedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:06.597122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1162/2341] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:21:06.601605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efbe09-35d9-418d-aad3-d02918feb468 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:06.627047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efbe09-35d9-418d-aad3-d02918feb468 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:06.633041 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:06.633797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.634145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.634491 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.635227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:21:06.635597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.637276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.653937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1180/2342] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:21:06.655215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78405e-d1f9-4d6e-be4a-7c70153caedc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:06.664922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78405e-d1f9-4d6e-be4a-7c70153caedc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:06.670082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a802f34-eda5-448c-af45-f0938a9ceb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:06.670694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802f34-eda5-448c-af45-f0938a9ceb5e admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.670967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802f34-eda5-448c-af45-f0938a9ceb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.671236 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a802f34-eda5-448c-af45-f0938a9ceb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.671889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a802f34-eda5-448c-af45-f0938a9ceb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.673885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a802f34-eda5-448c-af45-f0938a9ceb5e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.702587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1163/2343] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:21:06 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:21:06.706744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:06.716688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db0bfc-5368-47e6-a0ce-c513e8236154 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:06.775494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b94d6d-e218-4af4-877a-269f8227bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:06.776023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94d6d-e218-4af4-877a-269f8227bbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.776611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94d6d-e218-4af4-877a-269f8227bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.776890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b94d6d-e218-4af4-877a-269f8227bbc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.777569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b94d6d-e218-4af4-877a-269f8227bbc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.779499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b94d6d-e218-4af4-877a-269f8227bbc5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.804820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1181/2344] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:21:06 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:21:06.810902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a802f34-eda5-448c-af45-f0938a9ceb5e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:06.822331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a802f34-eda5-448c-af45-f0938a9ceb5e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:06.827937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa1da-3b87-4b3e-8659-11ea489b84b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:06.828794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa1da-3b87-4b3e-8659-11ea489b84b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.829070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa1da-3b87-4b3e-8659-11ea489b84b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.829378 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188aa1da-3b87-4b3e-8659-11ea489b84b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.830118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aa1da-3b87-4b3e-8659-11ea489b84b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.831729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188aa1da-3b87-4b3e-8659-11ea489b84b1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.845791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1164/2345] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:21:06.846979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b94d6d-e218-4af4-877a-269f8227bbc5 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:06.858721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b94d6d-e218-4af4-877a-269f8227bbc5 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:06.864361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7eb3e1-74aa-4c9e-87ac-306edfdd5abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:06.865021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb3e1-74aa-4c9e-87ac-306edfdd5abe admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.865308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb3e1-74aa-4c9e-87ac-306edfdd5abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.865670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7eb3e1-74aa-4c9e-87ac-306edfdd5abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.866510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eb3e1-74aa-4c9e-87ac-306edfdd5abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.868109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7eb3e1-74aa-4c9e-87ac-306edfdd5abe admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.881398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1182/2346] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:21:06.886181 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa1da-3b87-4b3e-8659-11ea489b84b1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:06.896725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188aa1da-3b87-4b3e-8659-11ea489b84b1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:06.903203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:06.903925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.904309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.904774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] PATH_INFO: `/v3/projects/518ba2c73b5b460293675a5ae2f64880/users/d84f5b41bdee419bbf751446d6b03103/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.921662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=518ba2c73b5b460293675a5ae2f64880, user_id=d84f5b41bdee419bbf751446d6b03103, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:06.924534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:06.941179 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1165/2347] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:21:06 2022] PUT /identity/v3/projects/518ba2c73b5b460293675a5ae2f64880/users/d84f5b41bdee419bbf751446d6b03103/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:06.952343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50170c07-a87b-4f01-9f7f-7c757b4f970e None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:06.952646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50170c07-a87b-4f01-9f7f-7c757b4f970e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:06.952930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50170c07-a87b-4f01-9f7f-7c757b4f970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:06.982386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-50170c07-a87b-4f01-9f7f-7c757b4f970e None None] MFA Rules not processed for user `d84f5b41bdee419bbf751446d6b03103`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:06.983610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-50170c07-a87b-4f01-9f7f-7c757b4f970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:07.052911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1183/2348] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:07.065420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:07.067389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:07.128776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66125b-6a1d-4e98-b672-3d75a915cf7f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:07.132958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf391935-eb66-48ae-9a9e-5008e7500a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:07.133607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391935-eb66-48ae-9a9e-5008e7500a93 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:07.133883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391935-eb66-48ae-9a9e-5008e7500a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:07.134157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf391935-eb66-48ae-9a9e-5008e7500a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:07.143405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf391935-eb66-48ae-9a9e-5008e7500a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:07.145555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf391935-eb66-48ae-9a9e-5008e7500a93 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:07.155520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1166/2349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:07.184181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50170c07-a87b-4f01-9f7f-7c757b4f970e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:07.238688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:07.259561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50170c07-a87b-4f01-9f7f-7c757b4f970e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:07.264199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:07.264836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:07.265118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:07.265412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] PATH_INFO: `/v3/users/d84f5b41bdee419bbf751446d6b03103` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:07.266704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84f5b41bdee419bbf751446d6b03103)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:07.268623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:07.321755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84f5b41bdee419bbf751446d6b03103'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.322523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84f5b41bdee419bbf751446d6b03103'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.334675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84f5b41bdee419bbf751446d6b03103'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.341870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84f5b41bdee419bbf751446d6b03103'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.350696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84f5b41bdee419bbf751446d6b03103'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.357514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1184/2350] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:21:07 2022] DELETE /identity/v3/users/d84f5b41bdee419bbf751446d6b03103 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:07.362239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f961da-fc8c-4842-918f-6af07d95f704 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:07.362527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f961da-fc8c-4842-918f-6af07d95f704 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:07.362805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f961da-fc8c-4842-918f-6af07d95f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:07.383990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f9f961da-fc8c-4842-918f-6af07d95f704 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:07.385240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f9f961da-fc8c-4842-918f-6af07d95f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:07.448088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1167/2351] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:07.458475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:07.460022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:07.518778 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a35a06-cac9-498b-9c87-3753297dc5f1 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:07.523521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:07.524169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:07.524450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:07.524724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:07.534420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:07.535869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:07.546460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1185/2352] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:07.684396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0a607-b2f0-44f6-b7ef-bf7656294816 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:07.684937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0a607-b2f0-44f6-b7ef-bf7656294816 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:07.685199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0a607-b2f0-44f6-b7ef-bf7656294816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:07.711213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d1b0a607-b2f0-44f6-b7ef-bf7656294816 None None] MFA Rules not processed for user `84ccab5497bc46f7934d27ea7f9f244d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:07.712721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d1b0a607-b2f0-44f6-b7ef-bf7656294816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:07.719076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:07.774092 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1168/2353] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:21:07.829376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:07.830764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:07.845191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe5ab6-3897-43e9-9d33-9c2d43be90eb service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:07.850849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:07.851654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:07.852008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:07.852193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] PATH_INFO: `/v3/projects/518ba2c73b5b460293675a5ae2f64880` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:07.853437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=518ba2c73b5b460293675a5ae2f64880)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:07.855543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:07.905751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518ba2c73b5b460293675a5ae2f64880', 'request_id': 'req-6f092347-1088-40e6-818a-216dbbeb5c33'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.911989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518ba2c73b5b460293675a5ae2f64880', 'request_id': 'req-6f092347-1088-40e6-818a-216dbbeb5c33'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.914427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:07.919372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518ba2c73b5b460293675a5ae2f64880', 'request_id': 'req-6f092347-1088-40e6-818a-216dbbeb5c33'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.933894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] The token cache is being invalidate because project 518ba2c73b5b460293675a5ae2f64880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:21:07.934187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.934839 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6f092347-1088-40e6-818a-216dbbeb5c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:07.936597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1186/2354] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:21:07 2022] DELETE /identity/v3/projects/518ba2c73b5b460293675a5ae2f64880 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:07.941653 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd205c-1ca5-491e-82b6-de05c097cd80 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:07.941944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd205c-1ca5-491e-82b6-de05c097cd80 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:07.942220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd205c-1ca5-491e-82b6-de05c097cd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:07.963798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-45dd205c-1ca5-491e-82b6-de05c097cd80 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:07.965978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-45dd205c-1ca5-491e-82b6-de05c097cd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:08.036881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1169/2355] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:08.045863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ad6c7-a719-4e88-8b59-fc26bdb741c6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.046252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ad6c7-a719-4e88-8b59-fc26bdb741c6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.046536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ad6c7-a719-4e88-8b59-fc26bdb741c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.089250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-983ad6c7-a719-4e88-8b59-fc26bdb741c6 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:08.090506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-983ad6c7-a719-4e88-8b59-fc26bdb741c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:08.101004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1187/2356] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:21:08.105624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd205c-1ca5-491e-82b6-de05c097cd80 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:08.118117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd205c-1ca5-491e-82b6-de05c097cd80 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:08.123633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:08.124370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.125034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.125034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.126062 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:21:08.126455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:08.128312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:08.142461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1170/2357] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:21:08.146819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ad6c7-a719-4e88-8b59-fc26bdb741c6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:08.158703 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ad6c7-a719-4e88-8b59-fc26bdb741c6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:08.165386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30369b55-7c40-4d03-9e44-0b7163b65620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:08.166210 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30369b55-7c40-4d03-9e44-0b7163b65620 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.166557 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30369b55-7c40-4d03-9e44-0b7163b65620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.166906 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30369b55-7c40-4d03-9e44-0b7163b65620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.167765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30369b55-7c40-4d03-9e44-0b7163b65620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:08.169922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30369b55-7c40-4d03-9e44-0b7163b65620 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:08.211490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1188/2358] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:21:08 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:21:08.215691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:08.226975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca57f0-4789-4d6f-87d9-d6a7619310d6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:08.315650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8405e-efff-4b9c-964b-18701caf8c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:08.316537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8405e-efff-4b9c-964b-18701caf8c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.316537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8405e-efff-4b9c-964b-18701caf8c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.316799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8405e-efff-4b9c-964b-18701caf8c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.317521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8405e-efff-4b9c-964b-18701caf8c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:08.319680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8405e-efff-4b9c-964b-18701caf8c90 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:08.352763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1171/2359] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:21:08 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:21:08.354450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30369b55-7c40-4d03-9e44-0b7163b65620 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:08.368226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30369b55-7c40-4d03-9e44-0b7163b65620 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:08.376742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f971e-cbb7-445b-a57a-1fd8a46663e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:08.377515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f971e-cbb7-445b-a57a-1fd8a46663e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.377887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f971e-cbb7-445b-a57a-1fd8a46663e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.378250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f971e-cbb7-445b-a57a-1fd8a46663e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.379052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f971e-cbb7-445b-a57a-1fd8a46663e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:08.381528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f971e-cbb7-445b-a57a-1fd8a46663e9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:08.398963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1189/2360] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:21:08.400176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8405e-efff-4b9c-964b-18701caf8c90 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:08.413575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8405e-efff-4b9c-964b-18701caf8c90 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:08.419532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f2eba-365b-4331-ac52-0565863e0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:08.431075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2eba-365b-4331-ac52-0565863e0837 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.433110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2eba-365b-4331-ac52-0565863e0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.433110 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2eba-365b-4331-ac52-0565863e0837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.434004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f2eba-365b-4331-ac52-0565863e0837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:08.437278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f2eba-365b-4331-ac52-0565863e0837 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:08.450151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1172/2361] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:21:08.454013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f971e-cbb7-445b-a57a-1fd8a46663e9 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:08.464580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f971e-cbb7-445b-a57a-1fd8a46663e9 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:08.469332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:08.469993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.470252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.470524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] PATH_INFO: `/v3/projects/5b318cb900ce4b749a0381c668a5bdee/users/bb83a2d6d86f4cc18e5ee315d4ea5841/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.491905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b318cb900ce4b749a0381c668a5bdee, user_id=bb83a2d6d86f4cc18e5ee315d4ea5841, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:08.495170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:08.512410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1190/2362] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:21:08 2022] PUT /identity/v3/projects/5b318cb900ce4b749a0381c668a5bdee/users/bb83a2d6d86f4cc18e5ee315d4ea5841/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:08.517986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6cf92-6bab-4762-8701-21d2c6d5ee3e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.518485 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6cf92-6bab-4762-8701-21d2c6d5ee3e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.518824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6cf92-6bab-4762-8701-21d2c6d5ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.539455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-96a6cf92-6bab-4762-8701-21d2c6d5ee3e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:08.540745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-96a6cf92-6bab-4762-8701-21d2c6d5ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:08.566208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:08.626467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1173/2363] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:08.636546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:08.638584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:08.724444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd95ce-1996-4967-82f2-ae828bf29bdc admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:08.728908 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:08.729413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:08.729694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:08.729968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:08.740676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:08.742573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:08.753272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1191/2364] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:12.869471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe243-a633-4a2d-99c3-79d3efe69799 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:12.870032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe243-a633-4a2d-99c3-79d3efe69799 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:12.870032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe243-a633-4a2d-99c3-79d3efe69799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:12.892025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d9bfe243-a633-4a2d-99c3-79d3efe69799 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:12.893297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d9bfe243-a633-4a2d-99c3-79d3efe69799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:12.966957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1174/2365] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:21:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:12.981954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:12.983493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:13.075776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469fde-a00a-4a31-88a5-22fee9c091c6 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:13.083357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c4459-f283-44ad-a30d-d70d72c03033 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:13.084993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c4459-f283-44ad-a30d-d70d72c03033 service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:13.086246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c4459-f283-44ad-a30d-d70d72c03033 service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:13.086522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c4459-f283-44ad-a30d-d70d72c03033 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:13.095944 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c4459-f283-44ad-a30d-d70d72c03033 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:13.097609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c4459-f283-44ad-a30d-d70d72c03033 service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:13.116729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1192/2366] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:21:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:16.130301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f08c-b565-4dac-9ce2-2c1a8b1ead7e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:16.130902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f08c-b565-4dac-9ce2-2c1a8b1ead7e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:16.131270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f08c-b565-4dac-9ce2-2c1a8b1ead7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:16.178387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8fa0f08c-b565-4dac-9ce2-2c1a8b1ead7e None None] MFA Rules not processed for user `bb83a2d6d86f4cc18e5ee315d4ea5841`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:16.180115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8fa0f08c-b565-4dac-9ce2-2c1a8b1ead7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:16.272091 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1175/2367] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:16.276825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c4459-f283-44ad-a30d-d70d72c03033 service swift] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:16.295117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c4459-f283-44ad-a30d-d70d72c03033 service swift] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:16.307232 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef8745-a0d7-48a4-b0b8-01312eafa5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:16.307650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef8745-a0d7-48a4-b0b8-01312eafa5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:16.307933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef8745-a0d7-48a4-b0b8-01312eafa5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:16.308200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef8745-a0d7-48a4-b0b8-01312eafa5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:16.308852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef8745-a0d7-48a4-b0b8-01312eafa5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:16.310815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef8745-a0d7-48a4-b0b8-01312eafa5d3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:16.358100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:16.381418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1193/2368] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:21:16 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:21:16.385512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0f08c-b565-4dac-9ce2-2c1a8b1ead7e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:16.398405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0f08c-b565-4dac-9ce2-2c1a8b1ead7e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:16.459779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:16.468496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b045-b70a-4d38-9fa8-b0863b255b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:16.469486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b045-b70a-4d38-9fa8-b0863b255b0f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:16.470096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b045-b70a-4d38-9fa8-b0863b255b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:16.470358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9b045-b70a-4d38-9fa8-b0863b255b0f admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:16.471366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9b045-b70a-4d38-9fa8-b0863b255b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:16.473446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9b045-b70a-4d38-9fa8-b0863b255b0f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:16.505521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1176/2369] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:21:16 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:21:16.510455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef8745-a0d7-48a4-b0b8-01312eafa5d3 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:16.523140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef8745-a0d7-48a4-b0b8-01312eafa5d3 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:16.533668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237ad72-912f-4773-8d78-2a0615462b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:16.534304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237ad72-912f-4773-8d78-2a0615462b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:16.534621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237ad72-912f-4773-8d78-2a0615462b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:16.534848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237ad72-912f-4773-8d78-2a0615462b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:16.535508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237ad72-912f-4773-8d78-2a0615462b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:16.537227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237ad72-912f-4773-8d78-2a0615462b4c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:16.550181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1194/2370] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:21:16.555727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b045-b70a-4d38-9fa8-b0863b255b0f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:16.565812 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9b045-b70a-4d38-9fa8-b0863b255b0f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:16.575818 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e484e-dbc6-42df-af1c-8b16b6ca0617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:16.576425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e484e-dbc6-42df-af1c-8b16b6ca0617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:16.582721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e484e-dbc6-42df-af1c-8b16b6ca0617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:16.582721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e484e-dbc6-42df-af1c-8b16b6ca0617 admin admin] PATH_INFO: `/v3/projects/0ee08c1ddfd54c1d88bf762d4fad61ca/users/ba59a17c6516481cb72f8ad57a793e1e/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:16.602088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e484e-dbc6-42df-af1c-8b16b6ca0617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee08c1ddfd54c1d88bf762d4fad61ca, user_id=ba59a17c6516481cb72f8ad57a793e1e, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:16.607005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e484e-dbc6-42df-af1c-8b16b6ca0617 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:16.624157 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1177/2371] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:21:16 2022] PUT /identity/v3/projects/0ee08c1ddfd54c1d88bf762d4fad61ca/users/ba59a17c6516481cb72f8ad57a793e1e/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:16.641873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237ad72-912f-4773-8d78-2a0615462b4c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:16.652899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237ad72-912f-4773-8d78-2a0615462b4c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:16.721385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc5126-7314-4b83-88c5-4c5d50f85201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:16.722225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5126-7314-4b83-88c5-4c5d50f85201 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:16.722558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5126-7314-4b83-88c5-4c5d50f85201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:16.722902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5126-7314-4b83-88c5-4c5d50f85201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:16.723684 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc5126-7314-4b83-88c5-4c5d50f85201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:16.725631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc5126-7314-4b83-88c5-4c5d50f85201 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:16.740604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1195/2372] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:21:16.744465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e484e-dbc6-42df-af1c-8b16b6ca0617 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:16.758450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e484e-dbc6-42df-af1c-8b16b6ca0617 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:16.772578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:16.773507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:16.773889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:16.774261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] PATH_INFO: `/v3/projects/0ee08c1ddfd54c1d88bf762d4fad61ca/users/ba59a17c6516481cb72f8ad57a793e1e/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:16.781908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee08c1ddfd54c1d88bf762d4fad61ca, user_id=ba59a17c6516481cb72f8ad57a793e1e, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:16.784941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:16.809425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1178/2373] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:21:16 2022] PUT /identity/v3/projects/0ee08c1ddfd54c1d88bf762d4fad61ca/users/ba59a17c6516481cb72f8ad57a793e1e/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:23.939271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aa5d2-3e39-4408-80d6-dd0722ecd4fe None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:23.939831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aa5d2-3e39-4408-80d6-dd0722ecd4fe None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:23.939831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606aa5d2-3e39-4408-80d6-dd0722ecd4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:23.973293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-606aa5d2-3e39-4408-80d6-dd0722ecd4fe None None] MFA Rules not processed for user `ba59a17c6516481cb72f8ad57a793e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:23.974907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-606aa5d2-3e39-4408-80d6-dd0722ecd4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:24.081968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1196/2374] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:24.095416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:24.098333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:24.215099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2773eb6-9ae0-419d-ba34-2c23200bfef2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:24.221275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42c49f-7f56-4f53-af2a-b3577f3fbdfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:24.222034 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c49f-7f56-4f53-af2a-b3577f3fbdfb service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:24.222406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c49f-7f56-4f53-af2a-b3577f3fbdfb service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:24.222856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42c49f-7f56-4f53-af2a-b3577f3fbdfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:24.332583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42c49f-7f56-4f53-af2a-b3577f3fbdfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:24.333496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42c49f-7f56-4f53-af2a-b3577f3fbdfb service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:24.346752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1179/2375] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:26.271679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ca1be-d6fa-47fa-8e31-1752994f4af0 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:26.272154 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ca1be-d6fa-47fa-8e31-1752994f4af0 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:26.272351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ca1be-d6fa-47fa-8e31-1752994f4af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:26.325431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8a2ca1be-d6fa-47fa-8e31-1752994f4af0 None None] MFA Rules not processed for user `bb83a2d6d86f4cc18e5ee315d4ea5841`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:26.326935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8a2ca1be-d6fa-47fa-8e31-1752994f4af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:26.348799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1197/2376] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:27.997742 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027827-b3e6-4efc-a070-05168c05be6a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:27.998299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027827-b3e6-4efc-a070-05168c05be6a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:27.998299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c027827-b3e6-4efc-a070-05168c05be6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:28.026324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6c027827-b3e6-4efc-a070-05168c05be6a None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:28.028450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6c027827-b3e6-4efc-a070-05168c05be6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:28.082008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:28.130835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1180/2377] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:21:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:28.147816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ca1be-d6fa-47fa-8e31-1752994f4af0 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:28.229664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:28.237804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ca1be-d6fa-47fa-8e31-1752994f4af0 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:28.243506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cf75f-764f-49eb-9a0a-78952d0756f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:28.244242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf75f-764f-49eb-9a0a-78952d0756f4 service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:28.244621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf75f-764f-49eb-9a0a-78952d0756f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:28.244994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf75f-764f-49eb-9a0a-78952d0756f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:28.254968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cf75f-764f-49eb-9a0a-78952d0756f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:28.256980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cf75f-764f-49eb-9a0a-78952d0756f4 service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:28.266527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1198/2378] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:21:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:28.857318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5162-74b3-4051-9856-13621c7c9731 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:28.857743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5162-74b3-4051-9856-13621c7c9731 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:28.858046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5162-74b3-4051-9856-13621c7c9731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:28.883186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-343d5162-74b3-4051-9856-13621c7c9731 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:28.884780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-343d5162-74b3-4051-9856-13621c7c9731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:28.896591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1181/2379] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 31 05:21:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:28.915440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cf75f-764f-49eb-9a0a-78952d0756f4 service swift] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:28.926751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cf75f-764f-49eb-9a0a-78952d0756f4 service swift] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:28.932399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101ad7-ebe2-4a26-aa8b-4f9729db5d15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:28.933046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101ad7-ebe2-4a26-aa8b-4f9729db5d15 service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:28.933357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101ad7-ebe2-4a26-aa8b-4f9729db5d15 service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:28.933630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a101ad7-ebe2-4a26-aa8b-4f9729db5d15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:28.944445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a101ad7-ebe2-4a26-aa8b-4f9729db5d15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:28.946170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a101ad7-ebe2-4a26-aa8b-4f9729db5d15 service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:28.968873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1199/2380] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:21:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:29.230522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd70c13-3b6d-42b2-89fd-73e63ddde1d5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:29.230522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd70c13-3b6d-42b2-89fd-73e63ddde1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:29.230522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd70c13-3b6d-42b2-89fd-73e63ddde1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:29.252481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6fd70c13-3b6d-42b2-89fd-73e63ddde1d5 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:29.255719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6fd70c13-3b6d-42b2-89fd-73e63ddde1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:29.266660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1182/2381] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:21:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:29.287987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101ad7-ebe2-4a26-aa8b-4f9729db5d15 service swift] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:29.299793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a101ad7-ebe2-4a26-aa8b-4f9729db5d15 service swift] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:29.305184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0068c08-18a6-45da-9619-b5810c246951 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:29.305807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0068c08-18a6-45da-9619-b5810c246951 service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:29.306306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0068c08-18a6-45da-9619-b5810c246951 service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:29.306570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0068c08-18a6-45da-9619-b5810c246951 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:29.320511 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0068c08-18a6-45da-9619-b5810c246951 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:29.323150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0068c08-18a6-45da-9619-b5810c246951 service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:29.335116 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1200/2382] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:29.734014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6d57-9d9a-4b2b-8380-9e894dd803b1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:29.734371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6d57-9d9a-4b2b-8380-9e894dd803b1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:29.734669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6d57-9d9a-4b2b-8380-9e894dd803b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:29.754989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d8ef6d57-9d9a-4b2b-8380-9e894dd803b1 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:29.756611 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d8ef6d57-9d9a-4b2b-8380-9e894dd803b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:29.764282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1183/2383] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 31 05:21:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:29.776966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0068c08-18a6-45da-9619-b5810c246951 service swift] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:29.788378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0068c08-18a6-45da-9619-b5810c246951 service swift] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:29.794508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b72033-9803-4e89-8073-dc0862c46bce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:29.795732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b72033-9803-4e89-8073-dc0862c46bce service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:29.796135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b72033-9803-4e89-8073-dc0862c46bce service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:29.796700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b72033-9803-4e89-8073-dc0862c46bce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:29.809423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b72033-9803-4e89-8073-dc0862c46bce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:29.811063 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b72033-9803-4e89-8073-dc0862c46bce service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:29.820060 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1201/2384] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:21:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:32.097210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef6d57-9d9a-4b2b-8380-9e894dd803b1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:32.098946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d8ef6d57-9d9a-4b2b-8380-9e894dd803b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:32.178188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef6d57-9d9a-4b2b-8380-9e894dd803b1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:32.184535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:32.185763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:32.186239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:32.186690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] PATH_INFO: `/v3/users/84ccab5497bc46f7934d27ea7f9f244d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:32.188082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ccab5497bc46f7934d27ea7f9f244d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:32.190502 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:32.243557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ccab5497bc46f7934d27ea7f9f244d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.260315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ccab5497bc46f7934d27ea7f9f244d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.268528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ccab5497bc46f7934d27ea7f9f244d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.279743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ccab5497bc46f7934d27ea7f9f244d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.280721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ccab5497bc46f7934d27ea7f9f244d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.290601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1184/2385] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:21:32 2022] DELETE /identity/v3/users/84ccab5497bc46f7934d27ea7f9f244d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:32.295365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2043-3d24-4a65-a1cb-2b852a9b2e7d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:32.295853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2043-3d24-4a65-a1cb-2b852a9b2e7d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:32.296253 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c2043-3d24-4a65-a1cb-2b852a9b2e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:32.316518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-3f5c2043-3d24-4a65-a1cb-2b852a9b2e7d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:32.317963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3f5c2043-3d24-4a65-a1cb-2b852a9b2e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:32.393680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1202/2386] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:32.405273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:32.407058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:32.472884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafc1dc-b532-4a35-a10d-6723ee926c94 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:32.476736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aed9b-e44c-4aa6-92a7-d707ef03f796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:32.477393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aed9b-e44c-4aa6-92a7-d707ef03f796 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:32.477670 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aed9b-e44c-4aa6-92a7-d707ef03f796 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:32.477982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aed9b-e44c-4aa6-92a7-d707ef03f796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:32.484159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:32.488793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aed9b-e44c-4aa6-92a7-d707ef03f796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:32.490580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aed9b-e44c-4aa6-92a7-d707ef03f796 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:32.503074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1185/2387] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:32.605645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386bc4-7a45-4477-b9b7-e83d3980d2d1 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:32.606030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386bc4-7a45-4477-b9b7-e83d3980d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:32.606366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e386bc4-7a45-4477-b9b7-e83d3980d2d1 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:32.608070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1203/2388] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:21:32.621309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713eb52-9e2d-4258-9ab1-b170d0a24eb4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:32.621896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713eb52-9e2d-4258-9ab1-b170d0a24eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:32.622403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713eb52-9e2d-4258-9ab1-b170d0a24eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:32.645148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5713eb52-9e2d-4258-9ab1-b170d0a24eb4 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:32.649662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5713eb52-9e2d-4258-9ab1-b170d0a24eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:32.698692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e386bc4-7a45-4477-b9b7-e83d3980d2d1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:32.700541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9e386bc4-7a45-4477-b9b7-e83d3980d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:32.728114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e386bc4-7a45-4477-b9b7-e83d3980d2d1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:32.734371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:32.734896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:32.735197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:32.735470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] PATH_INFO: `/v3/projects/87e0fc51a1fe483bb8f0fa22b47071d9` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:32.736587 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e0fc51a1fe483bb8f0fa22b47071d9)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:32.738754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:32.769445 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1186/2389] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:21:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:32.785201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713eb52-9e2d-4258-9ab1-b170d0a24eb4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:32.790896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5713eb52-9e2d-4258-9ab1-b170d0a24eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:32.803866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e0fc51a1fe483bb8f0fa22b47071d9', 'request_id': 'req-45707953-b85b-4424-8d38-c258c8064cf5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.810161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e0fc51a1fe483bb8f0fa22b47071d9', 'request_id': 'req-45707953-b85b-4424-8d38-c258c8064cf5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.818115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e0fc51a1fe483bb8f0fa22b47071d9', 'request_id': 'req-45707953-b85b-4424-8d38-c258c8064cf5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.838305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] The token cache is being invalidate because project 87e0fc51a1fe483bb8f0fa22b47071d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:21:32.838512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.839189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-45707953-b85b-4424-8d38-c258c8064cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:21:32.840760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1204/2390] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:21:32 2022] DELETE /identity/v3/projects/87e0fc51a1fe483bb8f0fa22b47071d9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:21:32.863492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713eb52-9e2d-4258-9ab1-b170d0a24eb4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:32.927432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70ee8f-11ce-43d1-927a-51f1fb22d014 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f45db0ea864a3299cccd7a74b7271b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:32.928120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ee8f-11ce-43d1-927a-51f1fb22d014 service glance] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:32.928481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ee8f-11ce-43d1-927a-51f1fb22d014 service glance] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:32.928916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ee8f-11ce-43d1-927a-51f1fb22d014 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:32.931074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8a70ee8f-11ce-43d1-927a-51f1fb22d014 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:32.996232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:33.019256 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70ee8f-11ce-43d1-927a-51f1fb22d014 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:33.020729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70ee8f-11ce-43d1-927a-51f1fb22d014 service glance] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:33.033262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1187/2391] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:33.110529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef75b-82cc-49bf-8974-90bc447642c4 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:33.110747 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef75b-82cc-49bf-8974-90bc447642c4 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:33.111008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef75b-82cc-49bf-8974-90bc447642c4 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:33.112545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1205/2392] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 05:21:33.117518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719bff-c0ed-4fe1-bd27-4a2cf353de28 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:33.118018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719bff-c0ed-4fe1-bd27-4a2cf353de28 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:33.118018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58719bff-c0ed-4fe1-bd27-4a2cf353de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:33.138685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-58719bff-c0ed-4fe1-bd27-4a2cf353de28 None None] MFA Rules not processed for user `45dadcdc0903427ca598dcd0bf06a6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:33.139919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-58719bff-c0ed-4fe1-bd27-4a2cf353de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:33.197640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1188/2393] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:21:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:33.211215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bef75b-82cc-49bf-8974-90bc447642c4 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:33.212953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e8bef75b-82cc-49bf-8974-90bc447642c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:33.226061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bef75b-82cc-49bf-8974-90bc447642c4 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:33.229597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f2815-6b64-4af5-a619-408efb09fcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:33.230196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2815-6b64-4af5-a619-408efb09fcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:33.230467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2815-6b64-4af5-a619-408efb09fcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:33.230732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2815-6b64-4af5-a619-408efb09fcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:33.238527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f2815-6b64-4af5-a619-408efb09fcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:33.239987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f2815-6b64-4af5-a619-408efb09fcb6 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:33.249174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1206/2394] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:21:33.333564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258bf3-0bf2-430b-8152-37613c7934c9 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:33.333852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258bf3-0bf2-430b-8152-37613c7934c9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:33.334126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22258bf3-0bf2-430b-8152-37613c7934c9 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:33.336097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1189/2395] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:21:33.341552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fd6f-31ac-456d-beb0-ff8545e034f7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:33.341986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fd6f-31ac-456d-beb0-ff8545e034f7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:33.342152 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fd6f-31ac-456d-beb0-ff8545e034f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:33.365389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7000fd6f-31ac-456d-beb0-ff8545e034f7 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:33.366575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7000fd6f-31ac-456d-beb0-ff8545e034f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:33.376681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1207/2396] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:21:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:33.388565 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22258bf3-0bf2-430b-8152-37613c7934c9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:33.403060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22258bf3-0bf2-430b-8152-37613c7934c9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:33.407790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:33.408667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:33.409038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:33.409569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:33.420979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:33.422598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:33.435811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1190/2397] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:36.015979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c145d-bb10-4241-9a36-a364a8f27f70 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:36.016486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c145d-bb10-4241-9a36-a364a8f27f70 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:36.016486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c145d-bb10-4241-9a36-a364a8f27f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:36.038944 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ce3c145d-bb10-4241-9a36-a364a8f27f70 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:36.040163 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ce3c145d-bb10-4241-9a36-a364a8f27f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:36.051196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:36.107155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1208/2398] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:21:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:36.133851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:36.135481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:36.214299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd268f31-b540-4cf6-b224-68410eb531e0 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:36.219740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbac2a-0761-4067-95a3-d49cd60e7da6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:36.220348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbac2a-0761-4067-95a3-d49cd60e7da6 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:36.220623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbac2a-0761-4067-95a3-d49cd60e7da6 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:36.220885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbac2a-0761-4067-95a3-d49cd60e7da6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:36.229857 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbac2a-0761-4067-95a3-d49cd60e7da6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:36.231470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbac2a-0761-4067-95a3-d49cd60e7da6 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:36.239575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1191/2399] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:21:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:46.098508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=19 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:46.236420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=69 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:21:53.439378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6933f-ba65-429f-96e2-863e1c9b1c40 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:53.439842 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6933f-ba65-429f-96e2-863e1c9b1c40 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:53.439947 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6933f-ba65-429f-96e2-863e1c9b1c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:53.461219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d7d6933f-ba65-429f-96e2-863e1c9b1c40 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:21:53.462425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d7d6933f-ba65-429f-96e2-863e1c9b1c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:53.471112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1209/2400] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 31 05:21:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:21:53.484698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbac2a-0761-4067-95a3-d49cd60e7da6 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:53.495777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbac2a-0761-4067-95a3-d49cd60e7da6 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:53.501280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:53.501890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:53.502165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:53.502433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:53.511377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:53.512989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:53.521979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1192/2401] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:21:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:21:54.280689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6933f-ba65-429f-96e2-863e1c9b1c40 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:54.282251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d7d6933f-ba65-429f-96e2-863e1c9b1c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:54.360318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6933f-ba65-429f-96e2-863e1c9b1c40 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:54.367792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccce89-e20b-46d1-8a80-74d5f5e42623 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:54.368419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccce89-e20b-46d1-8a80-74d5f5e42623 service placement] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:54.368697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccce89-e20b-46d1-8a80-74d5f5e42623 service placement] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:54.368962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccce89-e20b-46d1-8a80-74d5f5e42623 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:54.371070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4dccce89-e20b-46d1-8a80-74d5f5e42623 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:54.384935 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccce89-e20b-46d1-8a80-74d5f5e42623 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:54.386864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccce89-e20b-46d1-8a80-74d5f5e42623 service placement] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:54.398062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1210/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:21:58.732253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:21:58.734062 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:58.747098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985dd35-b357-4176-845f-1995b4199451 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:21:58.750838 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6651ad-e44a-47d7-a160-b0a865b46fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:21:58.751473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6651ad-e44a-47d7-a160-b0a865b46fbd service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:21:58.751947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6651ad-e44a-47d7-a160-b0a865b46fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:21:58.752488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6651ad-e44a-47d7-a160-b0a865b46fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:21:58.754706 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cd6651ad-e44a-47d7-a160-b0a865b46fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:21:58.836362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6651ad-e44a-47d7-a160-b0a865b46fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:21:58.838061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6651ad-e44a-47d7-a160-b0a865b46fbd service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:21:58.849007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1193/2403] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:21:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:22:04.394258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=35 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:07.450897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac87363-2f89-4f77-9092-ab984a98c640 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:22:07.451551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac87363-2f89-4f77-9092-ab984a98c640 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:22:07.451551 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac87363-2f89-4f77-9092-ab984a98c640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:22:07.471524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-1ac87363-2f89-4f77-9092-ab984a98c640 None None] MFA Rules not processed for user `9032773d56f84e7c889b189b21803c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:22:07.472649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1ac87363-2f89-4f77-9092-ab984a98c640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:22:07.528466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1211/2404] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:22:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:22:08.844066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=36 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:11.795499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111a70c-48b5-427a-8bd8-6e788949cf60 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:22:11.796305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111a70c-48b5-427a-8bd8-6e788949cf60 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:22:11.796305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111a70c-48b5-427a-8bd8-6e788949cf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:22:11.816238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9111a70c-48b5-427a-8bd8-6e788949cf60 None None] MFA Rules not processed for user `359f2e7aebf74167bf87af802bccdbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:22:11.817545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9111a70c-48b5-427a-8bd8-6e788949cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:22:11.880671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1194/2405] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:22:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:22:17.521072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=25 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:21.872989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=25 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:22:40.049251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0bfd-cd45-4c12-b27a-7b623f4515b6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:22:40.049804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0bfd-cd45-4c12-b27a-7b623f4515b6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:22:40.049804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf0bfd-cd45-4c12-b27a-7b623f4515b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:22:40.070437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-29bf0bfd-cd45-4c12-b27a-7b623f4515b6 None None] MFA Rules not processed for user `2f0c7305f2904f9cb68d17bc3e3f5582`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:22:40.071644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-29bf0bfd-cd45-4c12-b27a-7b623f4515b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:22:40.128067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1212/2406] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:22:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:22:50.119955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=25 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:16.329816 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019a547-e030-4147-9827-73641260d90a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:16.330396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019a547-e030-4147-9827-73641260d90a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:16.330536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019a547-e030-4147-9827-73641260d90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:16.352666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3019a547-e030-4147-9827-73641260d90a None None] MFA Rules not processed for user `9032773d56f84e7c889b189b21803c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:23:16.353934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3019a547-e030-4147-9827-73641260d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:16.361338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1195/2407] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:23:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:23:19.205688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf0bfd-cd45-4c12-b27a-7b623f4515b6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:19.207281 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-29bf0bfd-cd45-4c12-b27a-7b623f4515b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:19.318867 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf0bfd-cd45-4c12-b27a-7b623f4515b6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:19.324314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:19.325033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:19.325646 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:19.325922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] PATH_INFO: `/v3/users/359f2e7aebf74167bf87af802bccdbbb` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:19.327619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359f2e7aebf74167bf87af802bccdbbb)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:19.329779 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:19.395532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359f2e7aebf74167bf87af802bccdbbb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.396219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359f2e7aebf74167bf87af802bccdbbb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.409275 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359f2e7aebf74167bf87af802bccdbbb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.416960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359f2e7aebf74167bf87af802bccdbbb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.426334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b02bb867-b18b-4cac-be45-b4e62f5d46a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359f2e7aebf74167bf87af802bccdbbb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.435242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1213/2408] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:23:19 2022] DELETE /identity/v3/users/359f2e7aebf74167bf87af802bccdbbb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:23:19.645994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019a547-e030-4147-9827-73641260d90a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:19.660577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019a547-e030-4147-9827-73641260d90a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:19.726781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:19.727404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:19.727691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:19.727964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] PATH_INFO: `/v3/projects/58d905af768f4b92bc98a288ebce5d4b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:19.729142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d905af768f4b92bc98a288ebce5d4b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:19.731399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:19.791672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d905af768f4b92bc98a288ebce5d4b', 'request_id': 'req-24296b7e-7494-44e5-97bc-f1288ff4266c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.802336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d905af768f4b92bc98a288ebce5d4b', 'request_id': 'req-24296b7e-7494-44e5-97bc-f1288ff4266c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.808377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d905af768f4b92bc98a288ebce5d4b', 'request_id': 'req-24296b7e-7494-44e5-97bc-f1288ff4266c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.821911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] The token cache is being invalidate because project 58d905af768f4b92bc98a288ebce5d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:23:19.822220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.822858 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-24296b7e-7494-44e5-97bc-f1288ff4266c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:23:19.824567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1196/2409] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:23:19 2022] DELETE /identity/v3/projects/58d905af768f4b92bc98a288ebce5d4b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:23:19.829523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f69275-1681-4c1c-b512-5a1b904a4193 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:19.829818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f69275-1681-4c1c-b512-5a1b904a4193 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:19.830097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f69275-1681-4c1c-b512-5a1b904a4193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:19.858460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-07f69275-1681-4c1c-b512-5a1b904a4193 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:23:19.859725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-07f69275-1681-4c1c-b512-5a1b904a4193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:19.937724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1214/2410] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:23:19.945782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797762b-978f-44ed-9bfc-5b08b919c973 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:19.946782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797762b-978f-44ed-9bfc-5b08b919c973 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:19.947123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797762b-978f-44ed-9bfc-5b08b919c973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:19.975279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a797762b-978f-44ed-9bfc-5b08b919c973 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:23:19.976737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a797762b-978f-44ed-9bfc-5b08b919c973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:19.988747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1197/2411] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:23:19.993918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f69275-1681-4c1c-b512-5a1b904a4193 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:20.015078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f69275-1681-4c1c-b512-5a1b904a4193 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:20.024079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:20.025545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:20.026093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:20.026333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:20.033852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:23:20.034272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:20.036359 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:20.053461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1215/2412] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:23:20.059392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797762b-978f-44ed-9bfc-5b08b919c973 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:20.070203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797762b-978f-44ed-9bfc-5b08b919c973 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:20.076120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d63db-d1a6-4f5c-a66d-8d063bb0f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:20.076308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d63db-d1a6-4f5c-a66d-8d063bb0f7fa admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:20.076600 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d63db-d1a6-4f5c-a66d-8d063bb0f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:20.076895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d63db-d1a6-4f5c-a66d-8d063bb0f7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:20.077585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d63db-d1a6-4f5c-a66d-8d063bb0f7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:20.079636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d63db-d1a6-4f5c-a66d-8d063bb0f7fa admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:20.124813 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1198/2413] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:23:20 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:23:20.131067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:20.147038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a4ace-97ce-4d7d-bc37-6237e5b22d8a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:20.151863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:20.233732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4789ad1-6955-45cf-bc47-78836b6bceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:20.236122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4789ad1-6955-45cf-bc47-78836b6bceba admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:20.236401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4789ad1-6955-45cf-bc47-78836b6bceba admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:20.236737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4789ad1-6955-45cf-bc47-78836b6bceba admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:20.237618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4789ad1-6955-45cf-bc47-78836b6bceba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:20.241110 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4789ad1-6955-45cf-bc47-78836b6bceba admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:20.271158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1216/2414] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:23:20 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:23:20.281416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d63db-d1a6-4f5c-a66d-8d063bb0f7fa admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:20.292913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d63db-d1a6-4f5c-a66d-8d063bb0f7fa admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:20.297850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddee80d-1a3d-4e1f-b05f-7b2e8545c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:20.298475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee80d-1a3d-4e1f-b05f-7b2e8545c490 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:20.298751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee80d-1a3d-4e1f-b05f-7b2e8545c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:20.299019 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee80d-1a3d-4e1f-b05f-7b2e8545c490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:20.299665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddee80d-1a3d-4e1f-b05f-7b2e8545c490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:20.301494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddee80d-1a3d-4e1f-b05f-7b2e8545c490 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:20.313755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1199/2415] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:23:20.318443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4789ad1-6955-45cf-bc47-78836b6bceba admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:20.330113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4789ad1-6955-45cf-bc47-78836b6bceba admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:20.337860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545fa82-ef07-4741-a6ea-215d5c90cfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:20.338486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545fa82-ef07-4741-a6ea-215d5c90cfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:20.338762 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545fa82-ef07-4741-a6ea-215d5c90cfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:20.339084 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545fa82-ef07-4741-a6ea-215d5c90cfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:20.339735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545fa82-ef07-4741-a6ea-215d5c90cfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:20.345263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545fa82-ef07-4741-a6ea-215d5c90cfd1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:20.354725 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1217/2416] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:23:20.359167 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddee80d-1a3d-4e1f-b05f-7b2e8545c490 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:20.372117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddee80d-1a3d-4e1f-b05f-7b2e8545c490 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:20.377408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:20.378085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:20.378471 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:20.378748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] PATH_INFO: `/v3/projects/35eddd085ac649ed9b6ad6278ebe0a10/users/fd4b6cdf2af34a3da05bbc4b0e8f699d/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:20.400568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35eddd085ac649ed9b6ad6278ebe0a10, user_id=fd4b6cdf2af34a3da05bbc4b0e8f699d, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:20.405012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:20.425775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1200/2417] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:23:20 2022] PUT /identity/v3/projects/35eddd085ac649ed9b6ad6278ebe0a10/users/fd4b6cdf2af34a3da05bbc4b0e8f699d/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:23:20.431898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d6c4-9bfe-4ea1-a428-37e726ad703d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:20.432265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d6c4-9bfe-4ea1-a428-37e726ad703d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:20.432605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d6c4-9bfe-4ea1-a428-37e726ad703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:20.456844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8ff8d6c4-9bfe-4ea1-a428-37e726ad703d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:23:20.458336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8ff8d6c4-9bfe-4ea1-a428-37e726ad703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:20.549153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1218/2418] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:23:20.563735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:20.565732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:20.596774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:20.653772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b093-1631-4bf8-9494-dad17dcd78c0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:20.661695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:20.662456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:20.662951 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:20.663423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:20.678469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:20.680311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:20.693719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1201/2419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:23:25.134395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b784a-2cc1-4380-a8e7-76e7f7dca6e5 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:25.134913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b784a-2cc1-4380-a8e7-76e7f7dca6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:25.135013 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b784a-2cc1-4380-a8e7-76e7f7dca6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:25.164683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-438b784a-2cc1-4380-a8e7-76e7f7dca6e5 None None] MFA Rules not processed for user `fd4b6cdf2af34a3da05bbc4b0e8f699d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:23:25.165972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-438b784a-2cc1-4380-a8e7-76e7f7dca6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:25.246340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1219/2420] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:23:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:23:25.262433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:25.264948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:25.375482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aede6-18bc-4f02-8eb6-1d3aa2934ccc service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:25.381480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3bf3d-d1d1-4200-8357-c1d18c6e7ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:25.382119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3bf3d-d1d1-4200-8357-c1d18c6e7ccc service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:25.384643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3bf3d-d1d1-4200-8357-c1d18c6e7ccc service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:25.384643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3bf3d-d1d1-4200-8357-c1d18c6e7ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:25.395800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3bf3d-d1d1-4200-8357-c1d18c6e7ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:25.397528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3bf3d-d1d1-4200-8357-c1d18c6e7ccc service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:25.408097 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1202/2421] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:23:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:23:27.186239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a67d-8a92-447d-a586-ba2b0b3867c4 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:27.186850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a67d-8a92-447d-a586-ba2b0b3867c4 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:27.187127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a67d-8a92-447d-a586-ba2b0b3867c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:27.207618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-2a36a67d-8a92-447d-a586-ba2b0b3867c4 None None] MFA Rules not processed for user `fd4b6cdf2af34a3da05bbc4b0e8f699d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:23:27.208850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2a36a67d-8a92-447d-a586-ba2b0b3867c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:27.217219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1220/2422] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:23:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:23:35.406403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=51 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:37.201479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:23:47.771932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3bf3d-d1d1-4200-8357-c1d18c6e7ccc service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:47.783044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3bf3d-d1d1-4200-8357-c1d18c6e7ccc service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:47.786765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:47.787375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:47.787719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:47.788088 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:47.790249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:47.804998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:47.806730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:47.821726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1203/2423] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:23:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:23:47.907719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49d6b-0f5e-4a7a-8806-748d1dcb3883 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:47.908423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49d6b-0f5e-4a7a-8806-748d1dcb3883 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:47.908423 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c49d6b-0f5e-4a7a-8806-748d1dcb3883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:47.931541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-45c49d6b-0f5e-4a7a-8806-748d1dcb3883 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:23:47.933245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-45c49d6b-0f5e-4a7a-8806-748d1dcb3883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:48.008192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1221/2424] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:23:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:23:48.055909 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:48.057434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:48.130369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf6f22-43a3-4cef-80c8-2c2eaa60f330 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:48.136308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:48.136915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:48.137226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:48.137499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:48.146503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:48.148193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:48.156532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1204/2425] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:23:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:23:50.270328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c49d6b-0f5e-4a7a-8806-748d1dcb3883 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:23:50.274158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-45c49d6b-0f5e-4a7a-8806-748d1dcb3883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:50.285833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c49d6b-0f5e-4a7a-8806-748d1dcb3883 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:23:50.290299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc720a-1002-4240-9ac5-996fa4074ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:23:50.290946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc720a-1002-4240-9ac5-996fa4074ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:23:50.293687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc720a-1002-4240-9ac5-996fa4074ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:23:50.293687 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc720a-1002-4240-9ac5-996fa4074ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:23:50.295868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c5cc720a-1002-4240-9ac5-996fa4074ef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:23:50.311487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc720a-1002-4240-9ac5-996fa4074ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:23:50.313486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc720a-1002-4240-9ac5-996fa4074ef6 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:23:50.329621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1222/2426] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:23:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:23:58.153051 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=38 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:00.323986 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=31 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:01.622734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:01.624388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:01.698737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c1b4c-84cc-4e26-bbbc-40faed3005b6 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:01.704878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:01.705534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:01.705814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:01.706082 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:01.708017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:01.721113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:01.722726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:01.734295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1205/2427] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:03.453392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffc37-c316-4fca-b11a-665b5bb0b4d3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:03.453878 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffc37-c316-4fca-b11a-665b5bb0b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:03.453977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffc37-c316-4fca-b11a-665b5bb0b4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:03.474547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-e18ffc37-c316-4fca-b11a-665b5bb0b4d3 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:03.475786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e18ffc37-c316-4fca-b11a-665b5bb0b4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:03.484068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1223/2428] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:24:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:03.497577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:03.509683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd56cf1-381d-4ead-896e-536612662f1c service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:03.514847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9364-c127-48d3-99af-d1827897aff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:03.515468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9364-c127-48d3-99af-d1827897aff8 service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:03.515748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9364-c127-48d3-99af-d1827897aff8 service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:03.516014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9364-c127-48d3-99af-d1827897aff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:03.524726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9364-c127-48d3-99af-d1827897aff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:03.526734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9364-c127-48d3-99af-d1827897aff8 service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:03.535776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1206/2429] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:24:04.990382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ffc37-c316-4fca-b11a-665b5bb0b4d3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:04.991927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e18ffc37-c316-4fca-b11a-665b5bb0b4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:05.009981 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ffc37-c316-4fca-b11a-665b5bb0b4d3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:05.016880 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:05.017543 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:05.017826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:05.018097 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:05.020217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:05.081261 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:05.082860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:05.092304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1224/2430] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:06.749114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9364-c127-48d3-99af-d1827897aff8 service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:06.762137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9364-c127-48d3-99af-d1827897aff8 service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:06.769538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735262b-6187-478a-a6db-cce8d83aa663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:06.770169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735262b-6187-478a-a6db-cce8d83aa663 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:06.770464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735262b-6187-478a-a6db-cce8d83aa663 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:06.770737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735262b-6187-478a-a6db-cce8d83aa663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:06.772637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8735262b-6187-478a-a6db-cce8d83aa663 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:06.849745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735262b-6187-478a-a6db-cce8d83aa663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:06.851354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735262b-6187-478a-a6db-cce8d83aa663 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:06.860474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1207/2431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:13.117456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:13.130146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b1874-3159-4767-94dd-903ab3e6ebe1 service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:13.134393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb634b-4c92-4905-a97d-434bceb4e83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:13.135456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb634b-4c92-4905-a97d-434bceb4e83f service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:13.135456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb634b-4c92-4905-a97d-434bceb4e83f service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:13.135991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb634b-4c92-4905-a97d-434bceb4e83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:13.138370 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-aadb634b-4c92-4905-a97d-434bceb4e83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:13.149749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb634b-4c92-4905-a97d-434bceb4e83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:13.151324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb634b-4c92-4905-a97d-434bceb4e83f service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:13.160103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1225/2432] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:16.856401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=66 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:17.127930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057fdf-8584-4908-94c8-5a503b1acb66 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:17.128646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057fdf-8584-4908-94c8-5a503b1acb66 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:17.129071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057fdf-8584-4908-94c8-5a503b1acb66 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:17.131007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1208/2433] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:24:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:24:17.137183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7220-7a74-4ffa-9eb5-b2080715659d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:17.138131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7220-7a74-4ffa-9eb5-b2080715659d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:17.138420 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7220-7a74-4ffa-9eb5-b2080715659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:17.161302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a98c7220-7a74-4ffa-9eb5-b2080715659d None None] MFA Rules not processed for user `45dadcdc0903427ca598dcd0bf06a6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:17.162975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a98c7220-7a74-4ffa-9eb5-b2080715659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:17.170478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1226/2434] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:24:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:24:17.186366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68057fdf-8584-4908-94c8-5a503b1acb66 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:17.198120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68057fdf-8584-4908-94c8-5a503b1acb66 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:17.201981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e07985-0825-443c-8277-e471eae6f0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:17.202783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07985-0825-443c-8277-e471eae6f0dc service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:17.203078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07985-0825-443c-8277-e471eae6f0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:17.203476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e07985-0825-443c-8277-e471eae6f0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:17.217148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e07985-0825-443c-8277-e471eae6f0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:17.217148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e07985-0825-443c-8277-e471eae6f0dc service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:17.221737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1209/2435] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:17.329351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53cca-25a0-403b-8ff4-33806f6703f8 None None] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:17.329640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53cca-25a0-403b-8ff4-33806f6703f8 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:17.329916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe53cca-25a0-403b-8ff4-33806f6703f8 None None] PATH_INFO: `/` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:17.331700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1227/2436] 10.222.0.17 () {54 vars in 921 bytes} [Wed Aug 31 05:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 05:24:17.339315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48e4fa-cf3a-4c16-b0c0-01a44af43b64 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:17.339795 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48e4fa-cf3a-4c16-b0c0-01a44af43b64 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:17.340148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48e4fa-cf3a-4c16-b0c0-01a44af43b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:17.362144 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8e48e4fa-cf3a-4c16-b0c0-01a44af43b64 None None] MFA Rules not processed for user `7f5576a90945429a9127a2d4c53a729c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:17.363473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8e48e4fa-cf3a-4c16-b0c0-01a44af43b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:17.373247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1210/2437] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Aug 31 05:24:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:17.384205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53cca-25a0-403b-8ff4-33806f6703f8 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:17.395493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe53cca-25a0-403b-8ff4-33806f6703f8 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:17.398933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56939f-7799-4112-8642-92f38a4dcd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:17.399532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56939f-7799-4112-8642-92f38a4dcd49 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:17.399806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56939f-7799-4112-8642-92f38a4dcd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:17.400072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56939f-7799-4112-8642-92f38a4dcd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:17.410418 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56939f-7799-4112-8642-92f38a4dcd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:17.411847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56939f-7799-4112-8642-92f38a4dcd49 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:17.422992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1228/2438] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:20.764009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbd3e-4345-4a16-80ef-f5192da2fd7c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:20.764526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbd3e-4345-4a16-80ef-f5192da2fd7c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:20.764526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcbd3e-4345-4a16-80ef-f5192da2fd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:20.788249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-57fcbd3e-4345-4a16-80ef-f5192da2fd7c None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:20.789830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-57fcbd3e-4345-4a16-80ef-f5192da2fd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:20.799883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1211/2439] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 31 05:24:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:20.814476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56939f-7799-4112-8642-92f38a4dcd49 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:20.827898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56939f-7799-4112-8642-92f38a4dcd49 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:20.832822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:20.833449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:20.833709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:20.833977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:20.843647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:20.845469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:20.854716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1229/2440] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:24:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:24:29.393938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcbd3e-4345-4a16-80ef-f5192da2fd7c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:29.406511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcbd3e-4345-4a16-80ef-f5192da2fd7c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:29.411521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:29.412143 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:29.412440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:29.412702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:29.415040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:29.429299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:29.430960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:29.442555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1212/2441] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:30.850835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=52 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:33.232251 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:33.233856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:33.248100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953a1d5-1baa-421b-af48-d1799d75c109 service swift] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:33.252727 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:33.253384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:33.253659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:33.253926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] PATH_INFO: `/v3/users/9032773d56f84e7c889b189b21803c3b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:33.255023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9032773d56f84e7c889b189b21803c3b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:33.256939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:33.307790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9032773d56f84e7c889b189b21803c3b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.308330 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9032773d56f84e7c889b189b21803c3b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.321602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9032773d56f84e7c889b189b21803c3b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.331731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9032773d56f84e7c889b189b21803c3b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.344471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0298f215-9d0a-4336-9566-3efe161cf418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9032773d56f84e7c889b189b21803c3b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.350927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1230/2442] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:33 2022] DELETE /identity/v3/users/9032773d56f84e7c889b189b21803c3b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:33.539736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:33.550310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e8eb-4c86-4c93-a8c5-b4f13938247c service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:33.607922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:33.608588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:33.608970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:33.609215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] PATH_INFO: `/v3/projects/856381cca9134a25a8954d0751ff7f38` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:33.610386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856381cca9134a25a8954d0751ff7f38)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:33.612271 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:33.662171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856381cca9134a25a8954d0751ff7f38', 'request_id': 'req-7bb92cd7-bb90-44cc-ab49-70bd4a045688'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.672070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856381cca9134a25a8954d0751ff7f38', 'request_id': 'req-7bb92cd7-bb90-44cc-ab49-70bd4a045688'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.678030 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856381cca9134a25a8954d0751ff7f38', 'request_id': 'req-7bb92cd7-bb90-44cc-ab49-70bd4a045688'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.689130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] The token cache is being invalidate because project 856381cca9134a25a8954d0751ff7f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:33.689418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.690100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7bb92cd7-bb90-44cc-ab49-70bd4a045688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:33.691640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1213/2443] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:33 2022] DELETE /identity/v3/projects/856381cca9134a25a8954d0751ff7f38 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:33.696658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8c9c-465e-4a04-85fb-8e868d16ef3e None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:33.696939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8c9c-465e-4a04-85fb-8e868d16ef3e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:33.697236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8c9c-465e-4a04-85fb-8e868d16ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:33.717322 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fe2c8c9c-465e-4a04-85fb-8e868d16ef3e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:33.718530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fe2c8c9c-465e-4a04-85fb-8e868d16ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:33.782011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1231/2444] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:33.791482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab682-e3c7-4bec-95d5-389601ae669a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:33.791772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab682-e3c7-4bec-95d5-389601ae669a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:33.792072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab682-e3c7-4bec-95d5-389601ae669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:33.813548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-240ab682-e3c7-4bec-95d5-389601ae669a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:33.814909 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-240ab682-e3c7-4bec-95d5-389601ae669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:33.823998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1214/2445] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:33.828573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c8c9c-465e-4a04-85fb-8e868d16ef3e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:33.838570 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c8c9c-465e-4a04-85fb-8e868d16ef3e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:33.843347 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:33.843980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:33.844284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:33.844624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:33.845324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:24:33.845627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:33.847219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:33.858942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1232/2446] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 05:24:33.863440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab682-e3c7-4bec-95d5-389601ae669a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:33.872925 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab682-e3c7-4bec-95d5-389601ae669a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:33.878251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b20fc2-61be-48ec-aef2-b755e1cb2146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:33.878866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b20fc2-61be-48ec-aef2-b755e1cb2146 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:33.879278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b20fc2-61be-48ec-aef2-b755e1cb2146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:33.879553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b20fc2-61be-48ec-aef2-b755e1cb2146 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:33.880202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b20fc2-61be-48ec-aef2-b755e1cb2146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:33.882176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b20fc2-61be-48ec-aef2-b755e1cb2146 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:33.912242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1215/2447] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:33 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:33.916537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:33.927158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dccbe-ff2a-4f01-97f1-4af4db2f41db admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:33.985221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e853-ece8-49a3-87f5-3582fc63d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:33.985877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e853-ece8-49a3-87f5-3582fc63d72e admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:33.986118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e853-ece8-49a3-87f5-3582fc63d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:33.986390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40e853-ece8-49a3-87f5-3582fc63d72e admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:33.987030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40e853-ece8-49a3-87f5-3582fc63d72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:33.988932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40e853-ece8-49a3-87f5-3582fc63d72e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:33.996991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:34.017433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1233/2448] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:33 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:24:34.018645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b20fc2-61be-48ec-aef2-b755e1cb2146 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.028962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b20fc2-61be-48ec-aef2-b755e1cb2146 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.033970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2218ac-1d90-4031-a443-0625eddd1d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.034582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2218ac-1d90-4031-a443-0625eddd1d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.034863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2218ac-1d90-4031-a443-0625eddd1d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.035135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2218ac-1d90-4031-a443-0625eddd1d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.035782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2218ac-1d90-4031-a443-0625eddd1d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.037432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2218ac-1d90-4031-a443-0625eddd1d1d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.047418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1216/2449] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:24:34.051427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e853-ece8-49a3-87f5-3582fc63d72e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.061561 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40e853-ece8-49a3-87f5-3582fc63d72e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.066564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777869a-435e-4806-9f7d-4852ced80d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.067040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777869a-435e-4806-9f7d-4852ced80d69 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.067318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777869a-435e-4806-9f7d-4852ced80d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.067596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777869a-435e-4806-9f7d-4852ced80d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.068242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777869a-435e-4806-9f7d-4852ced80d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.069888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777869a-435e-4806-9f7d-4852ced80d69 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.085142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1234/2450] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:34.089589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2218ac-1d90-4031-a443-0625eddd1d1d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.100629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2218ac-1d90-4031-a443-0625eddd1d1d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.106498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c4df1-978b-480b-9507-1098209e6946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.107159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c4df1-978b-480b-9507-1098209e6946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.107435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c4df1-978b-480b-9507-1098209e6946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.107699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c4df1-978b-480b-9507-1098209e6946 admin admin] PATH_INFO: `/v3/projects/87da1fae9e0d4408897aa9072071b879/users/70bcde9ad7ae497f9c1f727b69d72ddb/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.116351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:34.123900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c4df1-978b-480b-9507-1098209e6946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87da1fae9e0d4408897aa9072071b879, user_id=70bcde9ad7ae497f9c1f727b69d72ddb, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.127161 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c4df1-978b-480b-9507-1098209e6946 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.141936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1217/2451] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:34 2022] PUT /identity/v3/projects/87da1fae9e0d4408897aa9072071b879/users/70bcde9ad7ae497f9c1f727b69d72ddb/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:34.152430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a793-008f-40e2-b702-4d955d7146a4 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.152741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a793-008f-40e2-b702-4d955d7146a4 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.153014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a793-008f-40e2-b702-4d955d7146a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.184335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-3142a793-008f-40e2-b702-4d955d7146a4 None None] MFA Rules not processed for user `70bcde9ad7ae497f9c1f727b69d72ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:34.185592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3142a793-008f-40e2-b702-4d955d7146a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:34.255573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1235/2452] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:24:34.260675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c4df1-978b-480b-9507-1098209e6946 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.335408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c4df1-978b-480b-9507-1098209e6946 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.340618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac1ea7-f0da-4610-b03e-af7ddd0b51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.341260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1ea7-f0da-4610-b03e-af7ddd0b51f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.341523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1ea7-f0da-4610-b03e-af7ddd0b51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.341794 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1ea7-f0da-4610-b03e-af7ddd0b51f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.342422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac1ea7-f0da-4610-b03e-af7ddd0b51f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.344621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac1ea7-f0da-4610-b03e-af7ddd0b51f0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.373791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1218/2453] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:34 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:34.379017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142a793-008f-40e2-b702-4d955d7146a4 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.394883 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142a793-008f-40e2-b702-4d955d7146a4 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.458966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ec691-c443-4596-91db-776dfbbb482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.459588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ec691-c443-4596-91db-776dfbbb482a admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.459912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ec691-c443-4596-91db-776dfbbb482a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.460175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ec691-c443-4596-91db-776dfbbb482a admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.460813 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ec691-c443-4596-91db-776dfbbb482a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.462804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ec691-c443-4596-91db-776dfbbb482a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.487734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1236/2454] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:34 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:34.491821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac1ea7-f0da-4610-b03e-af7ddd0b51f0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.502266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac1ea7-f0da-4610-b03e-af7ddd0b51f0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.507085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c65292-14f2-4248-9132-151f9595ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.507691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c65292-14f2-4248-9132-151f9595ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.507953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c65292-14f2-4248-9132-151f9595ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.508232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c65292-14f2-4248-9132-151f9595ba7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.508877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c65292-14f2-4248-9132-151f9595ba7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.510544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c65292-14f2-4248-9132-151f9595ba7a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.521004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1219/2455] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:34.525293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ec691-c443-4596-91db-776dfbbb482a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.536823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ec691-c443-4596-91db-776dfbbb482a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.542612 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aad3a-6f6c-4aea-b2b2-e5e2a52d1aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.543273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aad3a-6f6c-4aea-b2b2-e5e2a52d1aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.543554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aad3a-6f6c-4aea-b2b2-e5e2a52d1aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.543829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aad3a-6f6c-4aea-b2b2-e5e2a52d1aa3 admin admin] PATH_INFO: `/v3/projects/1bc10aab93b24bc19a77c6db9cb8d63e/users/d2879c7d8be8473d8bf0aa9409475ced/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.559897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aad3a-6f6c-4aea-b2b2-e5e2a52d1aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc10aab93b24bc19a77c6db9cb8d63e, user_id=d2879c7d8be8473d8bf0aa9409475ced, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.562681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aad3a-6f6c-4aea-b2b2-e5e2a52d1aa3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.578655 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1237/2456] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:34 2022] PUT /identity/v3/projects/1bc10aab93b24bc19a77c6db9cb8d63e/users/d2879c7d8be8473d8bf0aa9409475ced/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:34.584945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c65292-14f2-4248-9132-151f9595ba7a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.600748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c65292-14f2-4248-9132-151f9595ba7a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.663747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9bdba-f84a-4952-a849-49287f7adcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.664358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9bdba-f84a-4952-a849-49287f7adcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.664638 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9bdba-f84a-4952-a849-49287f7adcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.664905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9bdba-f84a-4952-a849-49287f7adcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.665591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9bdba-f84a-4952-a849-49287f7adcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.667190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9bdba-f84a-4952-a849-49287f7adcf6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.677514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1220/2457] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:34.682042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aad3a-6f6c-4aea-b2b2-e5e2a52d1aa3 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.693781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aad3a-6f6c-4aea-b2b2-e5e2a52d1aa3 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.701380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.702068 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.702344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.702603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] PATH_INFO: `/v3/projects/1bc10aab93b24bc19a77c6db9cb8d63e/users/d2879c7d8be8473d8bf0aa9409475ced/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.704890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc10aab93b24bc19a77c6db9cb8d63e, user_id=d2879c7d8be8473d8bf0aa9409475ced, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.707588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.718136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1238/2458] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:34 2022] PUT /identity/v3/projects/1bc10aab93b24bc19a77c6db9cb8d63e/users/d2879c7d8be8473d8bf0aa9409475ced/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:34.728929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8c3f-ba30-4674-aae8-69f24674acae None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.729245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8c3f-ba30-4674-aae8-69f24674acae None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.729519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8c3f-ba30-4674-aae8-69f24674acae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.758595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6ced8c3f-ba30-4674-aae8-69f24674acae None None] MFA Rules not processed for user `d2879c7d8be8473d8bf0aa9409475ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:34.760252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6ced8c3f-ba30-4674-aae8-69f24674acae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:34.803492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:34.827262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1221/2459] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:34.839069 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:34.841277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:34.864805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:34.903259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7080ed-8746-45cb-bd67-4fcaec90d461 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:34.908204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c1815-5179-4a6d-a143-a6b9c4bf1709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:34.908821 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1815-5179-4a6d-a143-a6b9c4bf1709 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:34.909111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1815-5179-4a6d-a143-a6b9c4bf1709 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:34.909398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1815-5179-4a6d-a143-a6b9c4bf1709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:34.918731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c1815-5179-4a6d-a143-a6b9c4bf1709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:34.920186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c1815-5179-4a6d-a143-a6b9c4bf1709 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:34.930477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1239/2460] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:36.376029 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced8c3f-ba30-4674-aae8-69f24674acae None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:36.450387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced8c3f-ba30-4674-aae8-69f24674acae None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:36.455862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:36.456560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:36.456833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:36.457118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] PATH_INFO: `/v3/users/70bcde9ad7ae497f9c1f727b69d72ddb` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:36.458366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bcde9ad7ae497f9c1f727b69d72ddb)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:36.460284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:36.508610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bcde9ad7ae497f9c1f727b69d72ddb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:36.520391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bcde9ad7ae497f9c1f727b69d72ddb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:36.527323 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bcde9ad7ae497f9c1f727b69d72ddb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:36.537537 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bcde9ad7ae497f9c1f727b69d72ddb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:36.538165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bcde9ad7ae497f9c1f727b69d72ddb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:36.544111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1222/2461] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:36 2022] DELETE /identity/v3/users/70bcde9ad7ae497f9c1f727b69d72ddb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:36.548913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e525-b385-417c-86cb-f50fcd072c62 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:36.549486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e525-b385-417c-86cb-f50fcd072c62 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:36.549486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528e525-b385-417c-86cb-f50fcd072c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:36.568887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0528e525-b385-417c-86cb-f50fcd072c62 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:36.570131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0528e525-b385-417c-86cb-f50fcd072c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:36.635909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1240/2462] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:24:36.646194 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:36.647756 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:36.710395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2f260-1e50-4a23-b57f-fd5c33f2394c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:36.714184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90871-3ddf-4d58-91f7-4ddcf1e1899e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:36.714793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90871-3ddf-4d58-91f7-4ddcf1e1899e service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:36.715068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90871-3ddf-4d58-91f7-4ddcf1e1899e service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:36.715338 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90871-3ddf-4d58-91f7-4ddcf1e1899e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:36.724802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea90871-3ddf-4d58-91f7-4ddcf1e1899e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:36.726315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea90871-3ddf-4d58-91f7-4ddcf1e1899e service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:36.735923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1223/2463] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:37.023292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528e525-b385-417c-86cb-f50fcd072c62 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:37.024929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0528e525-b385-417c-86cb-f50fcd072c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:37.041854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528e525-b385-417c-86cb-f50fcd072c62 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:37.054412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:37.055040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:37.055311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:37.055580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] PATH_INFO: `/v3/projects/87da1fae9e0d4408897aa9072071b879` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:37.056759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87da1fae9e0d4408897aa9072071b879)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:37.058765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:37.106683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87da1fae9e0d4408897aa9072071b879', 'request_id': 'req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.112025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87da1fae9e0d4408897aa9072071b879', 'request_id': 'req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.118014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87da1fae9e0d4408897aa9072071b879', 'request_id': 'req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.132234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] The token cache is being invalidate because project 87da1fae9e0d4408897aa9072071b879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:37.132522 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.133175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.134661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1241/2464] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:37 2022] DELETE /identity/v3/projects/87da1fae9e0d4408897aa9072071b879 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:37.138847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90871-3ddf-4d58-91f7-4ddcf1e1899e service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:37.145072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:37.149035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90871-3ddf-4d58-91f7-4ddcf1e1899e service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:37.207341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:37.207981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:37.208261 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:37.208530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] PATH_INFO: `/v3/users/d2879c7d8be8473d8bf0aa9409475ced` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:37.209730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2879c7d8be8473d8bf0aa9409475ced)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:37.211701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:37.261908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2879c7d8be8473d8bf0aa9409475ced'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.274617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2879c7d8be8473d8bf0aa9409475ced'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.282770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2879c7d8be8473d8bf0aa9409475ced'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.292182 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2879c7d8be8473d8bf0aa9409475ced'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.292855 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-71face8f-d36d-4699-b287-7fadfcbc4a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2879c7d8be8473d8bf0aa9409475ced'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.299399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1224/2465] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:37 2022] DELETE /identity/v3/users/d2879c7d8be8473d8bf0aa9409475ced => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:37.587119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:37.588659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:37.603064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525654f-1e6a-4d20-bb7b-5e5bd2c996f5 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:37.654871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:37.669055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:37.669723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:37.669996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:37.670263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] PATH_INFO: `/v3/projects/1bc10aab93b24bc19a77c6db9cb8d63e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:37.671386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc10aab93b24bc19a77c6db9cb8d63e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:37.673350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:37.723252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc10aab93b24bc19a77c6db9cb8d63e', 'request_id': 'req-166b6876-3eab-4113-933f-8007cb8e8d59'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.728987 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc10aab93b24bc19a77c6db9cb8d63e', 'request_id': 'req-166b6876-3eab-4113-933f-8007cb8e8d59'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.735748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc10aab93b24bc19a77c6db9cb8d63e', 'request_id': 'req-166b6876-3eab-4113-933f-8007cb8e8d59'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.749764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] The token cache is being invalidate because project 1bc10aab93b24bc19a77c6db9cb8d63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:37.750168 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.751155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-166b6876-3eab-4113-933f-8007cb8e8d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:37.752734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1242/2466] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:37 2022] DELETE /identity/v3/projects/1bc10aab93b24bc19a77c6db9cb8d63e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:37.758166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5910c2-9d24-48f8-9abb-7853169fa8a5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:37.758666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5910c2-9d24-48f8-9abb-7853169fa8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:37.758765 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5910c2-9d24-48f8-9abb-7853169fa8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:37.780292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7c5910c2-9d24-48f8-9abb-7853169fa8a5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:37.781892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7c5910c2-9d24-48f8-9abb-7853169fa8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:37.847622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1225/2467] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:37.857046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f71a-2692-4205-9141-a2685b13f5f3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:37.857354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f71a-2692-4205-9141-a2685b13f5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:37.857650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392f71a-2692-4205-9141-a2685b13f5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:37.878239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8392f71a-2692-4205-9141-a2685b13f5f3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:37.879457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8392f71a-2692-4205-9141-a2685b13f5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:37.888150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1243/2468] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:37.892768 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5910c2-9d24-48f8-9abb-7853169fa8a5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:37.903294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5910c2-9d24-48f8-9abb-7853169fa8a5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:37.908574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:37.909204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:37.909482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:37.909747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:37.910394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:24:37.910690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:37.912283 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:37.924329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1226/2469] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:24:37.928640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392f71a-2692-4205-9141-a2685b13f5f3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:37.938363 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392f71a-2692-4205-9141-a2685b13f5f3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:37.943963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cac81-5995-47e0-8ca8-480e4ecff492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:37.944567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cac81-5995-47e0-8ca8-480e4ecff492 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:37.944829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cac81-5995-47e0-8ca8-480e4ecff492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:37.945109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cac81-5995-47e0-8ca8-480e4ecff492 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:37.945774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cac81-5995-47e0-8ca8-480e4ecff492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:37.947716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cac81-5995-47e0-8ca8-480e4ecff492 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:37.980088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1244/2470] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:37 2022] POST /identity/v3/projects => generated 409 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:37.984360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:37.994469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e1d59-3f0b-4584-be2d-7136da936550 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.002999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:38.054677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fac59-9bc2-4a89-b3de-1c8b4199afca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.055204 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fac59-9bc2-4a89-b3de-1c8b4199afca admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.055479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fac59-9bc2-4a89-b3de-1c8b4199afca admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.055749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fac59-9bc2-4a89-b3de-1c8b4199afca admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.056384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fac59-9bc2-4a89-b3de-1c8b4199afca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.058365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fac59-9bc2-4a89-b3de-1c8b4199afca admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.082876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1227/2471] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:37 2022] POST /identity/v3/users => generated 305 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:38.087169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cac81-5995-47e0-8ca8-480e4ecff492 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.098001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cac81-5995-47e0-8ca8-480e4ecff492 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.102856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bc663-3a7b-4be5-9656-a4abff73e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.103450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bc663-3a7b-4be5-9656-a4abff73e717 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.103722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bc663-3a7b-4be5-9656-a4abff73e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.103988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bc663-3a7b-4be5-9656-a4abff73e717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.104614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bc663-3a7b-4be5-9656-a4abff73e717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.106231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bc663-3a7b-4be5-9656-a4abff73e717 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.116204 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1245/2472] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:24:38.120171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fac59-9bc2-4a89-b3de-1c8b4199afca admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.130619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fac59-9bc2-4a89-b3de-1c8b4199afca admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.135627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930fec3-f0c3-4638-9d83-75089c4110e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.136219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930fec3-f0c3-4638-9d83-75089c4110e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.136533 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930fec3-f0c3-4638-9d83-75089c4110e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.136767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930fec3-f0c3-4638-9d83-75089c4110e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.137438 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930fec3-f0c3-4638-9d83-75089c4110e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.139073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930fec3-f0c3-4638-9d83-75089c4110e1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.150522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1228/2473] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:38.155635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bc663-3a7b-4be5-9656-a4abff73e717 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.167614 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bc663-3a7b-4be5-9656-a4abff73e717 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.174623 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd86378-7065-4f4b-8f1a-afd8c4d72fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.175274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86378-7065-4f4b-8f1a-afd8c4d72fac admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.175547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86378-7065-4f4b-8f1a-afd8c4d72fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.175810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd86378-7065-4f4b-8f1a-afd8c4d72fac admin admin] PATH_INFO: `/v3/projects/bfb665cf4ce34d2488ad2a8779d3d5b1/users/cbf95aacc8c041e6b1094711f11ff622/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.191681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd86378-7065-4f4b-8f1a-afd8c4d72fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb665cf4ce34d2488ad2a8779d3d5b1, user_id=cbf95aacc8c041e6b1094711f11ff622, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.194352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd86378-7065-4f4b-8f1a-afd8c4d72fac admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.210308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1246/2474] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:38 2022] PUT /identity/v3/projects/bfb665cf4ce34d2488ad2a8779d3d5b1/users/cbf95aacc8c041e6b1094711f11ff622/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:24:38.221462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d4787-10f2-4202-847b-fe1a4e015261 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.221825 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d4787-10f2-4202-847b-fe1a4e015261 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.222173 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d4787-10f2-4202-847b-fe1a4e015261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.261717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-680d4787-10f2-4202-847b-fe1a4e015261 None None] MFA Rules not processed for user `cbf95aacc8c041e6b1094711f11ff622`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:38.262967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-680d4787-10f2-4202-847b-fe1a4e015261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:38.337446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1229/2475] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:38.342378 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd86378-7065-4f4b-8f1a-afd8c4d72fac admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.418479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd86378-7065-4f4b-8f1a-afd8c4d72fac admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.423827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541a6c-8f84-40db-bc19-b4b30ff9cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.424427 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541a6c-8f84-40db-bc19-b4b30ff9cab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.424701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541a6c-8f84-40db-bc19-b4b30ff9cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.425119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc541a6c-8f84-40db-bc19-b4b30ff9cab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.425764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc541a6c-8f84-40db-bc19-b4b30ff9cab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.427641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc541a6c-8f84-40db-bc19-b4b30ff9cab8 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.449652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:38.457693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1247/2476] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:38 2022] POST /identity/v3/projects => generated 409 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:38.461885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d4787-10f2-4202-847b-fe1a4e015261 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.476966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d4787-10f2-4202-847b-fe1a4e015261 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.545867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23254566-7e03-40ee-b2b6-cbb2090f5062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.546492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23254566-7e03-40ee-b2b6-cbb2090f5062 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.546774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23254566-7e03-40ee-b2b6-cbb2090f5062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.547049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23254566-7e03-40ee-b2b6-cbb2090f5062 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.547767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23254566-7e03-40ee-b2b6-cbb2090f5062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.549775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23254566-7e03-40ee-b2b6-cbb2090f5062 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.574874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1230/2477] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:38 2022] POST /identity/v3/users => generated 311 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:38.579035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541a6c-8f84-40db-bc19-b4b30ff9cab8 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.589843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc541a6c-8f84-40db-bc19-b4b30ff9cab8 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.595253 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6343-2485-4f26-b97f-8d09dc6b8dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.596037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6343-2485-4f26-b97f-8d09dc6b8dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.596374 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6343-2485-4f26-b97f-8d09dc6b8dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.596571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a6343-2485-4f26-b97f-8d09dc6b8dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.597472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a6343-2485-4f26-b97f-8d09dc6b8dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.599170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a6343-2485-4f26-b97f-8d09dc6b8dc1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.610598 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1248/2478] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:38.615005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23254566-7e03-40ee-b2b6-cbb2090f5062 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.626167 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23254566-7e03-40ee-b2b6-cbb2090f5062 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.631329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7824835-7c13-47fd-a46f-9423dad0b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.631619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824835-7c13-47fd-a46f-9423dad0b2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.631898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824835-7c13-47fd-a46f-9423dad0b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.632171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824835-7c13-47fd-a46f-9423dad0b2b9 admin admin] PATH_INFO: `/v3/projects/8838c1f69a594f588a3cb3cb7e58f2bd/users/5532bd9f52524c838886894fbcd0c38a/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.635656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:38.649972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7824835-7c13-47fd-a46f-9423dad0b2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8838c1f69a594f588a3cb3cb7e58f2bd, user_id=5532bd9f52524c838886894fbcd0c38a, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.652604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7824835-7c13-47fd-a46f-9423dad0b2b9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.667463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1231/2479] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:38 2022] PUT /identity/v3/projects/8838c1f69a594f588a3cb3cb7e58f2bd/users/5532bd9f52524c838886894fbcd0c38a/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:38.671525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6343-2485-4f26-b97f-8d09dc6b8dc1 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.682631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a6343-2485-4f26-b97f-8d09dc6b8dc1 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.743065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f2262-4d7f-4aaf-ab89-9322d57784b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.743678 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2262-4d7f-4aaf-ab89-9322d57784b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.743945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2262-4d7f-4aaf-ab89-9322d57784b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.744216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f2262-4d7f-4aaf-ab89-9322d57784b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.744865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f2262-4d7f-4aaf-ab89-9322d57784b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.746542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f2262-4d7f-4aaf-ab89-9322d57784b6 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.756916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1249/2480] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:38.763113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7824835-7c13-47fd-a46f-9423dad0b2b9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.778238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7824835-7c13-47fd-a46f-9423dad0b2b9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.784220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.785343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.785343 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.785504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] PATH_INFO: `/v3/projects/8838c1f69a594f588a3cb3cb7e58f2bd/users/5532bd9f52524c838886894fbcd0c38a/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.787685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8838c1f69a594f588a3cb3cb7e58f2bd, user_id=5532bd9f52524c838886894fbcd0c38a, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:38.790491 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:38.802589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1232/2481] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:38 2022] PUT /identity/v3/projects/8838c1f69a594f588a3cb3cb7e58f2bd/users/5532bd9f52524c838886894fbcd0c38a/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:38.814382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd95b8-57d8-454c-95ee-5f20937e2c1f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.814737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd95b8-57d8-454c-95ee-5f20937e2c1f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.815018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd95b8-57d8-454c-95ee-5f20937e2c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:38.846783 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-6cbd95b8-57d8-454c-95ee-5f20937e2c1f None None] MFA Rules not processed for user `5532bd9f52524c838886894fbcd0c38a`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:38.847925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6cbd95b8-57d8-454c-95ee-5f20937e2c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:38.917689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1250/2482] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:38 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:24:38.931234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:38.933111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:38.992821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3abe6-eb4e-4675-98e2-ed1a79187e60 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:38.997305 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966ef93-6ede-49e6-9665-58aff4cd616a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:38.997898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ef93-6ede-49e6-9665-58aff4cd616a service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:38.998169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ef93-6ede-49e6-9665-58aff4cd616a service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:38.998431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966ef93-6ede-49e6-9665-58aff4cd616a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:39.007982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966ef93-6ede-49e6-9665-58aff4cd616a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:39.009435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966ef93-6ede-49e6-9665-58aff4cd616a service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:39.019279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1233/2483] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:38 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:39.183227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd95b8-57d8-454c-95ee-5f20937e2c1f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:39.193907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd95b8-57d8-454c-95ee-5f20937e2c1f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:39.199006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1a824-5be3-45d1-a1c5-9707feef04a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:39.199619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1a824-5be3-45d1-a1c5-9707feef04a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:39.199898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1a824-5be3-45d1-a1c5-9707feef04a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:39.200169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1a824-5be3-45d1-a1c5-9707feef04a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:39.269737 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1a824-5be3-45d1-a1c5-9707feef04a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:39.271884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1a824-5be3-45d1-a1c5-9707feef04a4 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:39.281814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1251/2484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:39 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:44.678447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966ef93-6ede-49e6-9665-58aff4cd616a service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:44.743055 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966ef93-6ede-49e6-9665-58aff4cd616a service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:44.748680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:44.749364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:44.749643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:44.749912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] PATH_INFO: `/v3/users/cbf95aacc8c041e6b1094711f11ff622` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:44.751165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf95aacc8c041e6b1094711f11ff622)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:44.753531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:44.804304 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf95aacc8c041e6b1094711f11ff622'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:44.816983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf95aacc8c041e6b1094711f11ff622'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:44.824293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf95aacc8c041e6b1094711f11ff622'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:44.826917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:44.832791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf95aacc8c041e6b1094711f11ff622'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:44.833909 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf95aacc8c041e6b1094711f11ff622'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:44.840830 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1234/2485] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:44 2022] DELETE /identity/v3/users/cbf95aacc8c041e6b1094711f11ff622 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:44.845764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eed3c-a7a7-4b7d-8b9d-d464a1521759 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:44.846308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eed3c-a7a7-4b7d-8b9d-d464a1521759 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:44.846308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eed3c-a7a7-4b7d-8b9d-d464a1521759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:44.859820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:44.866554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-012eed3c-a7a7-4b7d-8b9d-d464a1521759 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:44.867862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-012eed3c-a7a7-4b7d-8b9d-d464a1521759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:44.941960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1252/2486] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:24:44.952065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:44.953731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:45.017114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789438ed-f569-4ebf-8aad-24e93117fd36 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:45.021467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214bd09-b12d-4bfb-962f-4f4ebe50c814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:45.022111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214bd09-b12d-4bfb-962f-4f4ebe50c814 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:45.022383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214bd09-b12d-4bfb-962f-4f4ebe50c814 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:45.022687 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214bd09-b12d-4bfb-962f-4f4ebe50c814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:45.032578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214bd09-b12d-4bfb-962f-4f4ebe50c814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:45.034098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214bd09-b12d-4bfb-962f-4f4ebe50c814 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:45.045926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1235/2487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:45.328364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012eed3c-a7a7-4b7d-8b9d-d464a1521759 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:45.330088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-012eed3c-a7a7-4b7d-8b9d-d464a1521759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:45.342448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012eed3c-a7a7-4b7d-8b9d-d464a1521759 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:45.348107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:45.348852 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:45.349301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:45.349580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] PATH_INFO: `/v3/projects/bfb665cf4ce34d2488ad2a8779d3d5b1` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:45.350830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb665cf4ce34d2488ad2a8779d3d5b1)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:45.353959 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:45.401659 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb665cf4ce34d2488ad2a8779d3d5b1', 'request_id': 'req-80e4e5b2-2953-4748-abf3-41c1969937c2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.407590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb665cf4ce34d2488ad2a8779d3d5b1', 'request_id': 'req-80e4e5b2-2953-4748-abf3-41c1969937c2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.414233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb665cf4ce34d2488ad2a8779d3d5b1', 'request_id': 'req-80e4e5b2-2953-4748-abf3-41c1969937c2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.429876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] The token cache is being invalidate because project bfb665cf4ce34d2488ad2a8779d3d5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:45.430247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.430949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.432634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1253/2488] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:45 2022] DELETE /identity/v3/projects/bfb665cf4ce34d2488ad2a8779d3d5b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:45.436851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214bd09-b12d-4bfb-962f-4f4ebe50c814 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:45.447770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214bd09-b12d-4bfb-962f-4f4ebe50c814 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:45.508042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:45.508671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:45.508945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:45.509247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] PATH_INFO: `/v3/users/5532bd9f52524c838886894fbcd0c38a` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:45.510443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5532bd9f52524c838886894fbcd0c38a)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:45.512337 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:45.563959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5532bd9f52524c838886894fbcd0c38a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.576987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5532bd9f52524c838886894fbcd0c38a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.585409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5532bd9f52524c838886894fbcd0c38a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.599823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5532bd9f52524c838886894fbcd0c38a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.600473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ef35c815-ab7f-4be7-80be-4813c241a135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5532bd9f52524c838886894fbcd0c38a'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:45.606977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1236/2489] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:45 2022] DELETE /identity/v3/users/5532bd9f52524c838886894fbcd0c38a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:45.895426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:45.897277 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:45.912028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4e5b2-2953-4748-abf3-41c1969937c2 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:45.975447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676915b-6819-4554-b558-af688a44619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:45.976093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676915b-6819-4554-b558-af688a44619e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:45.976373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676915b-6819-4554-b558-af688a44619e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:45.976645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676915b-6819-4554-b558-af688a44619e admin admin] PATH_INFO: `/v3/projects/8838c1f69a594f588a3cb3cb7e58f2bd` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:45.977827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676915b-6819-4554-b558-af688a44619e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8838c1f69a594f588a3cb3cb7e58f2bd)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:45.979772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676915b-6819-4554-b558-af688a44619e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.018349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:46.032273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b676915b-6819-4554-b558-af688a44619e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8838c1f69a594f588a3cb3cb7e58f2bd', 'request_id': 'req-b676915b-6819-4554-b558-af688a44619e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:46.037804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b676915b-6819-4554-b558-af688a44619e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8838c1f69a594f588a3cb3cb7e58f2bd', 'request_id': 'req-b676915b-6819-4554-b558-af688a44619e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:46.043943 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b676915b-6819-4554-b558-af688a44619e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8838c1f69a594f588a3cb3cb7e58f2bd', 'request_id': 'req-b676915b-6819-4554-b558-af688a44619e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:46.059898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b676915b-6819-4554-b558-af688a44619e admin admin] The token cache is being invalidate because project 8838c1f69a594f588a3cb3cb7e58f2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:46.060190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b676915b-6819-4554-b558-af688a44619e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:46.060897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b676915b-6819-4554-b558-af688a44619e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:46.062465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1254/2490] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:45 2022] DELETE /identity/v3/projects/8838c1f69a594f588a3cb3cb7e58f2bd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:46.067814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09c3c-049e-470b-80ff-b3dbc7df88d3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.068307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09c3c-049e-470b-80ff-b3dbc7df88d3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.068406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09c3c-049e-470b-80ff-b3dbc7df88d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.089535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3ce09c3c-049e-470b-80ff-b3dbc7df88d3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:46.090685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3ce09c3c-049e-470b-80ff-b3dbc7df88d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:46.101492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:46.165293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1237/2491] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:46.173692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c364-75f6-4771-816f-57dc4806b68c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.173998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c364-75f6-4771-816f-57dc4806b68c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.174271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6c364-75f6-4771-816f-57dc4806b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.194256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-22f6c364-75f6-4771-816f-57dc4806b68c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:46.195481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-22f6c364-75f6-4771-816f-57dc4806b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:46.203849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1255/2492] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:46.208307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09c3c-049e-470b-80ff-b3dbc7df88d3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.218196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09c3c-049e-470b-80ff-b3dbc7df88d3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.223881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.224492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.224771 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.225040 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.225721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:24:46.226028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.227648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.240301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1238/2493] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:24:46.246860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6c364-75f6-4771-816f-57dc4806b68c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.258864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6c364-75f6-4771-816f-57dc4806b68c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.265541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40519-f42b-4947-ab0c-c5cbe1cdaa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.266125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40519-f42b-4947-ab0c-c5cbe1cdaa30 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.266393 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40519-f42b-4947-ab0c-c5cbe1cdaa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.266681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40519-f42b-4947-ab0c-c5cbe1cdaa30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.267560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40519-f42b-4947-ab0c-c5cbe1cdaa30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.269546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40519-f42b-4947-ab0c-c5cbe1cdaa30 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.302558 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1256/2494] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:46 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:46.307599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.323136 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967e12e9-a486-471a-a05f-8ae2ba72cce1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.393613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8484558-042d-4a3f-939a-10a3cfcd7e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.394141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8484558-042d-4a3f-939a-10a3cfcd7e56 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.394417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8484558-042d-4a3f-939a-10a3cfcd7e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.394688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8484558-042d-4a3f-939a-10a3cfcd7e56 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.395313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8484558-042d-4a3f-939a-10a3cfcd7e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.397260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8484558-042d-4a3f-939a-10a3cfcd7e56 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.423418 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1239/2495] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:46 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:46.428206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40519-f42b-4947-ab0c-c5cbe1cdaa30 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.438675 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40519-f42b-4947-ab0c-c5cbe1cdaa30 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.443627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6b175-3b68-486c-b808-c0b7fa942c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.444228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b175-3b68-486c-b808-c0b7fa942c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.444501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b175-3b68-486c-b808-c0b7fa942c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.444766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b175-3b68-486c-b808-c0b7fa942c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.445434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6b175-3b68-486c-b808-c0b7fa942c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.447056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6b175-3b68-486c-b808-c0b7fa942c37 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.457345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1257/2496] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:46.461510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8484558-042d-4a3f-939a-10a3cfcd7e56 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.472009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8484558-042d-4a3f-939a-10a3cfcd7e56 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.477153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86fe44-347d-4cd9-85ed-43d8ce484ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.477777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fe44-347d-4cd9-85ed-43d8ce484ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.478078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fe44-347d-4cd9-85ed-43d8ce484ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.478352 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86fe44-347d-4cd9-85ed-43d8ce484ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.479012 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86fe44-347d-4cd9-85ed-43d8ce484ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.480663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86fe44-347d-4cd9-85ed-43d8ce484ec5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.491557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1240/2497] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:46.495715 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6b175-3b68-486c-b808-c0b7fa942c37 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.506128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6b175-3b68-486c-b808-c0b7fa942c37 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.511117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80eb88-b539-4bf7-8f24-a72af5607c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.511755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80eb88-b539-4bf7-8f24-a72af5607c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.512028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80eb88-b539-4bf7-8f24-a72af5607c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.512292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80eb88-b539-4bf7-8f24-a72af5607c23 admin admin] PATH_INFO: `/v3/projects/cbf2d0466c0d4f0989b756b0c286702e/users/919b92ef15f949ae8c8bde10bd29dfb6/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.527392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80eb88-b539-4bf7-8f24-a72af5607c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf2d0466c0d4f0989b756b0c286702e, user_id=919b92ef15f949ae8c8bde10bd29dfb6, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.530461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80eb88-b539-4bf7-8f24-a72af5607c23 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.546845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1258/2498] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:46 2022] PUT /identity/v3/projects/cbf2d0466c0d4f0989b756b0c286702e/users/919b92ef15f949ae8c8bde10bd29dfb6/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:46.557625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce451-a28e-4a9c-af04-619337d13d3d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.557911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce451-a28e-4a9c-af04-619337d13d3d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.558190 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ce451-a28e-4a9c-af04-619337d13d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.588346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-421ce451-a28e-4a9c-af04-619337d13d3d None None] MFA Rules not processed for user `919b92ef15f949ae8c8bde10bd29dfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:46.589694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-421ce451-a28e-4a9c-af04-619337d13d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:46.656705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1241/2499] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:46.661377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80eb88-b539-4bf7-8f24-a72af5607c23 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.730754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80eb88-b539-4bf7-8f24-a72af5607c23 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.736249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe331-4936-4dac-90ba-eda54fc627d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.736618 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe331-4936-4dac-90ba-eda54fc627d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.736896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe331-4936-4dac-90ba-eda54fc627d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.737184 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe331-4936-4dac-90ba-eda54fc627d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.737809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe331-4936-4dac-90ba-eda54fc627d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.739776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe331-4936-4dac-90ba-eda54fc627d4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.770215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1259/2500] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:46 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:46.774464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce451-a28e-4a9c-af04-619337d13d3d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.786066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ce451-a28e-4a9c-af04-619337d13d3d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.794373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:46.848054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6874-0ae3-4c88-8747-c68589236d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.848667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6874-0ae3-4c88-8747-c68589236d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.848941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6874-0ae3-4c88-8747-c68589236d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.849284 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6874-0ae3-4c88-8747-c68589236d30 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.849852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6874-0ae3-4c88-8747-c68589236d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.851747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6874-0ae3-4c88-8747-c68589236d30 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.874269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1242/2501] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:46 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:46.879452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe331-4936-4dac-90ba-eda54fc627d4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.890364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe331-4936-4dac-90ba-eda54fc627d4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.896106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95f6cb-bd54-418f-8d70-e92976e13365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.896699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f6cb-bd54-418f-8d70-e92976e13365 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.896967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f6cb-bd54-418f-8d70-e92976e13365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.897273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f6cb-bd54-418f-8d70-e92976e13365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.897917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95f6cb-bd54-418f-8d70-e92976e13365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.899521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95f6cb-bd54-418f-8d70-e92976e13365 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.910775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1260/2502] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:46.915317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6874-0ae3-4c88-8747-c68589236d30 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.931427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6874-0ae3-4c88-8747-c68589236d30 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.939364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0ef9-e04f-4ea1-a8ca-1e4825436ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.939961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0ef9-e04f-4ea1-a8ca-1e4825436ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.940243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0ef9-e04f-4ea1-a8ca-1e4825436ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.940512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0ef9-e04f-4ea1-a8ca-1e4825436ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.941151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0ef9-e04f-4ea1-a8ca-1e4825436ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.942776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0ef9-e04f-4ea1-a8ca-1e4825436ac0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:46.952975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1243/2503] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:46.957472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95f6cb-bd54-418f-8d70-e92976e13365 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:46.967968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95f6cb-bd54-418f-8d70-e92976e13365 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:46.973846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d2c0b-15dd-46a7-9f0d-ef2275b25cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:46.974492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d2c0b-15dd-46a7-9f0d-ef2275b25cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:46.974769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d2c0b-15dd-46a7-9f0d-ef2275b25cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:46.975037 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d2c0b-15dd-46a7-9f0d-ef2275b25cc5 admin admin] PATH_INFO: `/v3/projects/e78dfd8f74aa424c8ee7d2370a68c085/users/df17286c53a34523bef4d517b70e99df/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:46.990814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d2c0b-15dd-46a7-9f0d-ef2275b25cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78dfd8f74aa424c8ee7d2370a68c085, user_id=df17286c53a34523bef4d517b70e99df, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:46.993479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d2c0b-15dd-46a7-9f0d-ef2275b25cc5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.013771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1261/2504] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:46 2022] PUT /identity/v3/projects/e78dfd8f74aa424c8ee7d2370a68c085/users/df17286c53a34523bef4d517b70e99df/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:24:47.025696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb08b4-7891-460d-9972-71be14b4bf08 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.025979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb08b4-7891-460d-9972-71be14b4bf08 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.026246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb08b4-7891-460d-9972-71be14b4bf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.056843 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8ccb08b4-7891-460d-9972-71be14b4bf08 None None] MFA Rules not processed for user `df17286c53a34523bef4d517b70e99df`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:47.058104 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8ccb08b4-7891-460d-9972-71be14b4bf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:47.126221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1244/2505] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:47.131685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d2c0b-15dd-46a7-9f0d-ef2275b25cc5 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:47.145640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:47.203602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d2c0b-15dd-46a7-9f0d-ef2275b25cc5 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:47.209293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40376be1-1d6f-4d03-bfee-c0058d2e463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:47.209912 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376be1-1d6f-4d03-bfee-c0058d2e463c admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.210189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376be1-1d6f-4d03-bfee-c0058d2e463c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.210458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40376be1-1d6f-4d03-bfee-c0058d2e463c admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.211088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40376be1-1d6f-4d03-bfee-c0058d2e463c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:47.213031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40376be1-1d6f-4d03-bfee-c0058d2e463c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.250607 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1262/2506] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:47 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:47.255042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb08b4-7891-460d-9972-71be14b4bf08 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:47.266488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb08b4-7891-460d-9972-71be14b4bf08 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:47.330102 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d4065-dc86-4193-a5ec-c64068562330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:47.330717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d4065-dc86-4193-a5ec-c64068562330 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.330996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d4065-dc86-4193-a5ec-c64068562330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.331266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d4065-dc86-4193-a5ec-c64068562330 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.331910 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d4065-dc86-4193-a5ec-c64068562330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:47.333878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d4065-dc86-4193-a5ec-c64068562330 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.358146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1245/2507] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:47 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:47.362384 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40376be1-1d6f-4d03-bfee-c0058d2e463c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:47.373290 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40376be1-1d6f-4d03-bfee-c0058d2e463c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:47.378622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093062c-64d0-4944-a796-5fb07d409394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:47.379216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093062c-64d0-4944-a796-5fb07d409394 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.379492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093062c-64d0-4944-a796-5fb07d409394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.379764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093062c-64d0-4944-a796-5fb07d409394 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.380407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093062c-64d0-4944-a796-5fb07d409394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:47.382025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093062c-64d0-4944-a796-5fb07d409394 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.393064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1263/2508] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:47.397387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d4065-dc86-4193-a5ec-c64068562330 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:47.407992 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d4065-dc86-4193-a5ec-c64068562330 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:47.413785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae36e6-95f4-40a7-99bd-8931f25478c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:47.414448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae36e6-95f4-40a7-99bd-8931f25478c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.414735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae36e6-95f4-40a7-99bd-8931f25478c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.415007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae36e6-95f4-40a7-99bd-8931f25478c5 admin admin] PATH_INFO: `/v3/projects/b7ba127580604a98921f65705e51305e/users/034cfdb2cc4a4d07aba62a7d3924e451/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.418473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:47.432612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae36e6-95f4-40a7-99bd-8931f25478c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ba127580604a98921f65705e51305e, user_id=034cfdb2cc4a4d07aba62a7d3924e451, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:47.435275 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae36e6-95f4-40a7-99bd-8931f25478c5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.451466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1246/2509] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:47 2022] PUT /identity/v3/projects/b7ba127580604a98921f65705e51305e/users/034cfdb2cc4a4d07aba62a7d3924e451/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:47.455758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093062c-64d0-4944-a796-5fb07d409394 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:47.465879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093062c-64d0-4944-a796-5fb07d409394 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:47.524428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeab16-407f-4867-8f90-8b819af69b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:47.525023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeab16-407f-4867-8f90-8b819af69b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.525398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeab16-407f-4867-8f90-8b819af69b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.525665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeab16-407f-4867-8f90-8b819af69b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.526302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeab16-407f-4867-8f90-8b819af69b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:47.527884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeab16-407f-4867-8f90-8b819af69b90 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.538179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1264/2510] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:47.542723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae36e6-95f4-40a7-99bd-8931f25478c5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:47.553677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae36e6-95f4-40a7-99bd-8931f25478c5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:47.559650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:47.560316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.560599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.560872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] PATH_INFO: `/v3/projects/b7ba127580604a98921f65705e51305e/users/034cfdb2cc4a4d07aba62a7d3924e451/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.562971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ba127580604a98921f65705e51305e, user_id=034cfdb2cc4a4d07aba62a7d3924e451, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:47.565920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.576470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1247/2511] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:47 2022] PUT /identity/v3/projects/b7ba127580604a98921f65705e51305e/users/034cfdb2cc4a4d07aba62a7d3924e451/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:47.586771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8bdc-7030-4a71-8f91-04d67fd316e6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.587052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8bdc-7030-4a71-8f91-04d67fd316e6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.587318 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e8bdc-7030-4a71-8f91-04d67fd316e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.616221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-463e8bdc-7030-4a71-8f91-04d67fd316e6 None None] MFA Rules not processed for user `034cfdb2cc4a4d07aba62a7d3924e451`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:47.617630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-463e8bdc-7030-4a71-8f91-04d67fd316e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:47.689079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1265/2512] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:47.700801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:47.702669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:47.761703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408698-b8d9-4b03-96af-31d4ddc7eb67 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:47.765828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b4ec6-e51e-4590-a230-fcb334b1e689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:47.766436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4ec6-e51e-4590-a230-fcb334b1e689 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.766703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4ec6-e51e-4590-a230-fcb334b1e689 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.766976 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4ec6-e51e-4590-a230-fcb334b1e689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.776739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b4ec6-e51e-4590-a230-fcb334b1e689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:47.778197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b4ec6-e51e-4590-a230-fcb334b1e689 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.788137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1248/2513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:47.836504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e8bdc-7030-4a71-8f91-04d67fd316e6 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:47.838258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-463e8bdc-7030-4a71-8f91-04d67fd316e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:47.845949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:47.852179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e8bdc-7030-4a71-8f91-04d67fd316e6 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:47.856891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039bb7a-faae-4142-9625-ca1e47bd0b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:47.857801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039bb7a-faae-4142-9625-ca1e47bd0b32 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:47.858146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039bb7a-faae-4142-9625-ca1e47bd0b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:47.858446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039bb7a-faae-4142-9625-ca1e47bd0b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:47.914738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039bb7a-faae-4142-9625-ca1e47bd0b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:47.916161 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039bb7a-faae-4142-9625-ca1e47bd0b32 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:47.927078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1266/2514] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:50.908694 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b4ec6-e51e-4590-a230-fcb334b1e689 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:50.977046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b4ec6-e51e-4590-a230-fcb334b1e689 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:50.982340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:50.982952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:50.983233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:50.983508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] PATH_INFO: `/v3/users/919b92ef15f949ae8c8bde10bd29dfb6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:50.984692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919b92ef15f949ae8c8bde10bd29dfb6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:50.987165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:51.042637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919b92ef15f949ae8c8bde10bd29dfb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.055286 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919b92ef15f949ae8c8bde10bd29dfb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.062721 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919b92ef15f949ae8c8bde10bd29dfb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.065249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:51.072098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919b92ef15f949ae8c8bde10bd29dfb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.072799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919b92ef15f949ae8c8bde10bd29dfb6'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.080199 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1249/2515] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:50 2022] DELETE /identity/v3/users/919b92ef15f949ae8c8bde10bd29dfb6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:51.084877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd1b6-7997-4a4c-a3b8-350b3ecf9c73 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:51.085343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd1b6-7997-4a4c-a3b8-350b3ecf9c73 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:51.085456 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd1b6-7997-4a4c-a3b8-350b3ecf9c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:51.106132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ab4bd1b6-7997-4a4c-a3b8-350b3ecf9c73 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:51.107359 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ab4bd1b6-7997-4a4c-a3b8-350b3ecf9c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:51.171461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1267/2516] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:51.181639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:51.183072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:51.246242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638276e4-ff7b-4632-b79b-917a2a3e45d9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:51.251306 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde449-e854-4624-bf2f-4edb4a012dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:51.252076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde449-e854-4624-bf2f-4edb4a012dba service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:51.252355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde449-e854-4624-bf2f-4edb4a012dba service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:51.252622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afde449-e854-4624-bf2f-4edb4a012dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:51.262767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afde449-e854-4624-bf2f-4edb4a012dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:51.264382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afde449-e854-4624-bf2f-4edb4a012dba service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:51.274028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1250/2517] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:24:51.556242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd1b6-7997-4a4c-a3b8-350b3ecf9c73 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:51.557843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ab4bd1b6-7997-4a4c-a3b8-350b3ecf9c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:51.575003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd1b6-7997-4a4c-a3b8-350b3ecf9c73 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:51.581553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:51.582205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:51.582480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:51.582828 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] PATH_INFO: `/v3/projects/cbf2d0466c0d4f0989b756b0c286702e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:51.584021 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf2d0466c0d4f0989b756b0c286702e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:51.586129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:51.648008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf2d0466c0d4f0989b756b0c286702e', 'request_id': 'req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.653732 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf2d0466c0d4f0989b756b0c286702e', 'request_id': 'req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.660555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf2d0466c0d4f0989b756b0c286702e', 'request_id': 'req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.680831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] The token cache is being invalidate because project cbf2d0466c0d4f0989b756b0c286702e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:51.681036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.681697 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.683248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1268/2518] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:51 2022] DELETE /identity/v3/projects/cbf2d0466c0d4f0989b756b0c286702e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:51.687551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde449-e854-4624-bf2f-4edb4a012dba service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:51.701921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afde449-e854-4624-bf2f-4edb4a012dba service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:51.763823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:51.764482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:51.764752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:51.765017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] PATH_INFO: `/v3/users/df17286c53a34523bef4d517b70e99df` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:51.766198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df17286c53a34523bef4d517b70e99df)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:51.768672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:51.817301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df17286c53a34523bef4d517b70e99df'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.828772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df17286c53a34523bef4d517b70e99df'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.835551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df17286c53a34523bef4d517b70e99df'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.843917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df17286c53a34523bef4d517b70e99df'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.844609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df17286c53a34523bef4d517b70e99df'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:51.851042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1251/2519] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:51 2022] DELETE /identity/v3/users/df17286c53a34523bef4d517b70e99df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:52.140302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:52.142046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:52.156565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19dd76-bcc2-4ef9-9c64-8b2332ee6aed admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:52.179791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:52.219837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:52.220478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:52.220752 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:52.221023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] PATH_INFO: `/v3/projects/e78dfd8f74aa424c8ee7d2370a68c085` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:52.222239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78dfd8f74aa424c8ee7d2370a68c085)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:52.224126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:52.277252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78dfd8f74aa424c8ee7d2370a68c085', 'request_id': 'req-e7eecc76-ee67-40f6-8412-f0a6186755fd'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.283580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78dfd8f74aa424c8ee7d2370a68c085', 'request_id': 'req-e7eecc76-ee67-40f6-8412-f0a6186755fd'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.289866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78dfd8f74aa424c8ee7d2370a68c085', 'request_id': 'req-e7eecc76-ee67-40f6-8412-f0a6186755fd'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.304547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] The token cache is being invalidate because project e78dfd8f74aa424c8ee7d2370a68c085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:52.304833 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.305458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.306985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1269/2520] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:52 2022] DELETE /identity/v3/projects/e78dfd8f74aa424c8ee7d2370a68c085 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:52.311141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:52.312602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:52.326069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67036dea-47bf-494f-9c03-3479f8c3fbe4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:52.338354 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:52.387317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:52.387969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:52.388244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:52.388515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] PATH_INFO: `/v3/users/034cfdb2cc4a4d07aba62a7d3924e451` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:52.389675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=034cfdb2cc4a4d07aba62a7d3924e451)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:52.391622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:52.441000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034cfdb2cc4a4d07aba62a7d3924e451'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.452675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034cfdb2cc4a4d07aba62a7d3924e451'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.460209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034cfdb2cc4a4d07aba62a7d3924e451'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.470871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034cfdb2cc4a4d07aba62a7d3924e451'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.471773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7276ce44-1488-4b01-8bab-a785d23ddbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034cfdb2cc4a4d07aba62a7d3924e451'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.478106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1252/2521] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:52 2022] DELETE /identity/v3/users/034cfdb2cc4a4d07aba62a7d3924e451 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:52.763836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:52.765390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:52.778532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eecc76-ee67-40f6-8412-f0a6186755fd admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:52.839434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:52.840164 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:52.840439 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:52.840734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] PATH_INFO: `/v3/projects/b7ba127580604a98921f65705e51305e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:52.842071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ba127580604a98921f65705e51305e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:52.843994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:52.894500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ba127580604a98921f65705e51305e', 'request_id': 'req-9a82472d-ed60-42cf-a111-0d3614cd59b2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.899337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:52.900826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ba127580604a98921f65705e51305e', 'request_id': 'req-9a82472d-ed60-42cf-a111-0d3614cd59b2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.909564 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ba127580604a98921f65705e51305e', 'request_id': 'req-9a82472d-ed60-42cf-a111-0d3614cd59b2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.923610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] The token cache is being invalidate because project b7ba127580604a98921f65705e51305e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:52.923911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.924588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9a82472d-ed60-42cf-a111-0d3614cd59b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:52.926125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1270/2522] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:52 2022] DELETE /identity/v3/projects/b7ba127580604a98921f65705e51305e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:52.932273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b040b76-47c3-44aa-bea1-70960d0e9920 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:52.932561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b040b76-47c3-44aa-bea1-70960d0e9920 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:52.932835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b040b76-47c3-44aa-bea1-70960d0e9920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:52.952416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3b040b76-47c3-44aa-bea1-70960d0e9920 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:52.953655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3b040b76-47c3-44aa-bea1-70960d0e9920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:53.015475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1253/2523] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:53.023859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355e4b-c0e2-4249-a327-e7edcf4518fe None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.024140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355e4b-c0e2-4249-a327-e7edcf4518fe None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.024413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355e4b-c0e2-4249-a327-e7edcf4518fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.045249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8d355e4b-c0e2-4249-a327-e7edcf4518fe None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:53.046465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8d355e4b-c0e2-4249-a327-e7edcf4518fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:53.055199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1271/2524] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:53.059684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b040b76-47c3-44aa-bea1-70960d0e9920 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.070189 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b040b76-47c3-44aa-bea1-70960d0e9920 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.075584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.076188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.076466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.076762 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.077498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:24:53.077801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.079467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.091566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1254/2525] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:24:53.096108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355e4b-c0e2-4249-a327-e7edcf4518fe None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.105940 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355e4b-c0e2-4249-a327-e7edcf4518fe None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.111946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81337a-6a1e-4131-81b5-956e4349520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.112568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81337a-6a1e-4131-81b5-956e4349520c admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.112847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81337a-6a1e-4131-81b5-956e4349520c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.113138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81337a-6a1e-4131-81b5-956e4349520c admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.113835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81337a-6a1e-4131-81b5-956e4349520c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.115771 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81337a-6a1e-4131-81b5-956e4349520c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.149573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1272/2526] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:53 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:53.154076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.165518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b150fa-0491-4c22-82f3-d322644f55b2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.185276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:53.224313 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066042-85c9-40dd-b8af-1a5b061c6af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.224930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066042-85c9-40dd-b8af-1a5b061c6af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.225248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066042-85c9-40dd-b8af-1a5b061c6af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.225538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066042-85c9-40dd-b8af-1a5b061c6af0 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.226159 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6066042-85c9-40dd-b8af-1a5b061c6af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.228086 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6066042-85c9-40dd-b8af-1a5b061c6af0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.253917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1255/2527] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:53 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:53.260498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81337a-6a1e-4131-81b5-956e4349520c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.274388 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81337a-6a1e-4131-81b5-956e4349520c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.280199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea058406-58bb-4ab6-8bde-cf55d8d04e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.280805 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058406-58bb-4ab6-8bde-cf55d8d04e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.281099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058406-58bb-4ab6-8bde-cf55d8d04e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.281394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea058406-58bb-4ab6-8bde-cf55d8d04e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.282048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea058406-58bb-4ab6-8bde-cf55d8d04e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.283704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea058406-58bb-4ab6-8bde-cf55d8d04e94 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.294031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1273/2528] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:53.297988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066042-85c9-40dd-b8af-1a5b061c6af0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.308614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066042-85c9-40dd-b8af-1a5b061c6af0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.314414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ade7f-f023-4f59-b28e-f2ad129d5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.315118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ade7f-f023-4f59-b28e-f2ad129d5aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.315399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ade7f-f023-4f59-b28e-f2ad129d5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.315666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ade7f-f023-4f59-b28e-f2ad129d5aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.316311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ade7f-f023-4f59-b28e-f2ad129d5aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.317997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ade7f-f023-4f59-b28e-f2ad129d5aa5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.329112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1256/2529] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:53.333591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea058406-58bb-4ab6-8bde-cf55d8d04e94 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.343876 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea058406-58bb-4ab6-8bde-cf55d8d04e94 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.349016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86051bb0-6761-4ba4-8669-28cf623a2383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.349709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051bb0-6761-4ba4-8669-28cf623a2383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.349989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051bb0-6761-4ba4-8669-28cf623a2383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.350255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86051bb0-6761-4ba4-8669-28cf623a2383 admin admin] PATH_INFO: `/v3/projects/19706f92a237417098b93357b78fc3cd/users/7c0afb401efa445487d0774307509cdb/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.365581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86051bb0-6761-4ba4-8669-28cf623a2383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19706f92a237417098b93357b78fc3cd, user_id=7c0afb401efa445487d0774307509cdb, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.368246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86051bb0-6761-4ba4-8669-28cf623a2383 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.384014 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1274/2530] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:53 2022] PUT /identity/v3/projects/19706f92a237417098b93357b78fc3cd/users/7c0afb401efa445487d0774307509cdb/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:53.396470 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529193-ec91-44de-a27e-167d39736abd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.396752 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529193-ec91-44de-a27e-167d39736abd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.397021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529193-ec91-44de-a27e-167d39736abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.425591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-98529193-ec91-44de-a27e-167d39736abd None None] MFA Rules not processed for user `7c0afb401efa445487d0774307509cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:53.426799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-98529193-ec91-44de-a27e-167d39736abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:53.495099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1257/2531] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:53.500965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86051bb0-6761-4ba4-8669-28cf623a2383 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.569734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86051bb0-6761-4ba4-8669-28cf623a2383 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.575449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330bad4-23a3-473a-8083-524ab9a42306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.576329 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330bad4-23a3-473a-8083-524ab9a42306 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.576611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330bad4-23a3-473a-8083-524ab9a42306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.576885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330bad4-23a3-473a-8083-524ab9a42306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.577562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330bad4-23a3-473a-8083-524ab9a42306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.579749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330bad4-23a3-473a-8083-524ab9a42306 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.610379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1275/2532] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:53 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:24:53.614889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98529193-ec91-44de-a27e-167d39736abd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.626292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98529193-ec91-44de-a27e-167d39736abd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.688711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724ac0-b062-42f9-af4a-795405dee0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.689430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724ac0-b062-42f9-af4a-795405dee0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.689713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724ac0-b062-42f9-af4a-795405dee0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.689983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724ac0-b062-42f9-af4a-795405dee0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.690623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc724ac0-b062-42f9-af4a-795405dee0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.692555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc724ac0-b062-42f9-af4a-795405dee0a9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.718967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1258/2533] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:53 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:53.721848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330bad4-23a3-473a-8083-524ab9a42306 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.732770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330bad4-23a3-473a-8083-524ab9a42306 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.738048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe132b5-02d8-43ed-b09c-58bb39804019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.738649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe132b5-02d8-43ed-b09c-58bb39804019 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.738929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe132b5-02d8-43ed-b09c-58bb39804019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.739224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe132b5-02d8-43ed-b09c-58bb39804019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.739872 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe132b5-02d8-43ed-b09c-58bb39804019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.741550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe132b5-02d8-43ed-b09c-58bb39804019 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.752377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1276/2534] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:53.756620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724ac0-b062-42f9-af4a-795405dee0a9 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.767044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724ac0-b062-42f9-af4a-795405dee0a9 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.772054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e349-d989-4661-a78d-70f0e58b7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.772710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e349-d989-4661-a78d-70f0e58b7936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.773004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e349-d989-4661-a78d-70f0e58b7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.773315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583e349-d989-4661-a78d-70f0e58b7936 admin admin] PATH_INFO: `/v3/projects/6eaceec629f54c6d85a0b49bde88ccc5/users/a0664c8c3bd640eab1c5a18988c2c2cc/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.788639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e349-d989-4661-a78d-70f0e58b7936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eaceec629f54c6d85a0b49bde88ccc5, user_id=a0664c8c3bd640eab1c5a18988c2c2cc, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.791332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583e349-d989-4661-a78d-70f0e58b7936 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.794596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:53.808448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1259/2535] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:53 2022] PUT /identity/v3/projects/6eaceec629f54c6d85a0b49bde88ccc5/users/a0664c8c3bd640eab1c5a18988c2c2cc/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:53.813765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe132b5-02d8-43ed-b09c-58bb39804019 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.829665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe132b5-02d8-43ed-b09c-58bb39804019 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.886689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:53.895138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096747b-6004-4c13-950f-712142cb394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.896038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096747b-6004-4c13-950f-712142cb394f admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.896371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096747b-6004-4c13-950f-712142cb394f admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.896642 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096747b-6004-4c13-950f-712142cb394f admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.897351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096747b-6004-4c13-950f-712142cb394f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.899018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096747b-6004-4c13-950f-712142cb394f admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.910179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1277/2536] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:24:53.914593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e349-d989-4661-a78d-70f0e58b7936 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:53.925662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583e349-d989-4661-a78d-70f0e58b7936 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:53.933869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:53.934618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.934932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.935254 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] PATH_INFO: `/v3/projects/6eaceec629f54c6d85a0b49bde88ccc5/users/a0664c8c3bd640eab1c5a18988c2c2cc/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.938996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eaceec629f54c6d85a0b49bde88ccc5, user_id=a0664c8c3bd640eab1c5a18988c2c2cc, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:53.943125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:53.958656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1260/2537] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:53 2022] PUT /identity/v3/projects/6eaceec629f54c6d85a0b49bde88ccc5/users/a0664c8c3bd640eab1c5a18988c2c2cc/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:53.969364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cd3f1-24b7-4421-af77-3f29cf4f4707 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:53.969650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cd3f1-24b7-4421-af77-3f29cf4f4707 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:53.969926 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cd3f1-24b7-4421-af77-3f29cf4f4707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:53.999930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-407cd3f1-24b7-4421-af77-3f29cf4f4707 None None] MFA Rules not processed for user `a0664c8c3bd640eab1c5a18988c2c2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:54.001226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-407cd3f1-24b7-4421-af77-3f29cf4f4707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:54.075035 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1278/2538] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:54.088183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:54.089940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:54.157679 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e83ea5-89cb-41e6-a0bd-d122fb218252 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:54.162101 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bf4a8-f3a8-48e1-847c-beeabf849893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:54.162730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bf4a8-f3a8-48e1-847c-beeabf849893 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:54.163004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bf4a8-f3a8-48e1-847c-beeabf849893 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:54.163298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bf4a8-f3a8-48e1-847c-beeabf849893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:54.173167 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bf4a8-f3a8-48e1-847c-beeabf849893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:54.174805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bf4a8-f3a8-48e1-847c-beeabf849893 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:54.185594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1261/2539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:54.820809 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cd3f1-24b7-4421-af77-3f29cf4f4707 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:54.886099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cd3f1-24b7-4421-af77-3f29cf4f4707 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:54.890949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:54.891602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:54.891882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:54.892147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] PATH_INFO: `/v3/users/7c0afb401efa445487d0774307509cdb` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:54.893724 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0afb401efa445487d0774307509cdb)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:54.895633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:54.946229 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0afb401efa445487d0774307509cdb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:54.946861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0afb401efa445487d0774307509cdb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:54.958917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0afb401efa445487d0774307509cdb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:54.965996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0afb401efa445487d0774307509cdb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:54.969976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:54.975562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0afb401efa445487d0774307509cdb'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:54.982975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1279/2540] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:54 2022] DELETE /identity/v3/users/7c0afb401efa445487d0774307509cdb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:54.987895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870b5b-46f3-4f8a-abe7-feb4d013449b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:54.988410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870b5b-46f3-4f8a-abe7-feb4d013449b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:54.988519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870b5b-46f3-4f8a-abe7-feb4d013449b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:55.008950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ea870b5b-46f3-4f8a-abe7-feb4d013449b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:55.010210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ea870b5b-46f3-4f8a-abe7-feb4d013449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:55.083884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1262/2541] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:24:55.094267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:55.095816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:55.153636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eb6a5-0569-4f3f-b06f-48efe7907846 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:55.158015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bd566-02fc-4c15-909f-2f2f0e0dbaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:55.159007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bd566-02fc-4c15-909f-2f2f0e0dbaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:55.159283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bd566-02fc-4c15-909f-2f2f0e0dbaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:55.159549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bd566-02fc-4c15-909f-2f2f0e0dbaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:55.169203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bd566-02fc-4c15-909f-2f2f0e0dbaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:55.170649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bd566-02fc-4c15-909f-2f2f0e0dbaf0 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:55.179878 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1280/2542] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:55.448602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870b5b-46f3-4f8a-abe7-feb4d013449b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:55.450184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ea870b5b-46f3-4f8a-abe7-feb4d013449b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:55.464681 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870b5b-46f3-4f8a-abe7-feb4d013449b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:55.473056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:55.474099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:55.474557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:55.475780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] PATH_INFO: `/v3/projects/19706f92a237417098b93357b78fc3cd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:55.476566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19706f92a237417098b93357b78fc3cd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:55.479068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:55.529044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19706f92a237417098b93357b78fc3cd', 'request_id': 'req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.538651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19706f92a237417098b93357b78fc3cd', 'request_id': 'req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.544691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19706f92a237417098b93357b78fc3cd', 'request_id': 'req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.558325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] The token cache is being invalidate because project 19706f92a237417098b93357b78fc3cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:55.558684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.559415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.561124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1263/2543] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:55 2022] DELETE /identity/v3/projects/19706f92a237417098b93357b78fc3cd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:55.565749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bd566-02fc-4c15-909f-2f2f0e0dbaf0 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:55.576465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bd566-02fc-4c15-909f-2f2f0e0dbaf0 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:55.638030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:55.638030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:55.638338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:55.638571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] PATH_INFO: `/v3/users/a0664c8c3bd640eab1c5a18988c2c2cc` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:55.639695 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0664c8c3bd640eab1c5a18988c2c2cc)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:55.641644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:55.693151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0664c8c3bd640eab1c5a18988c2c2cc'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.693844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0664c8c3bd640eab1c5a18988c2c2cc'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.706624 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0664c8c3bd640eab1c5a18988c2c2cc'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.714130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0664c8c3bd640eab1c5a18988c2c2cc'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.724483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-6435dce0-1483-4d5f-9afa-25c36cab6b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0664c8c3bd640eab1c5a18988c2c2cc'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:55.731008 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1281/2544] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:55 2022] DELETE /identity/v3/users/a0664c8c3bd640eab1c5a18988c2c2cc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:24:56.056784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.058416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:56.074520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f03f2-5bac-454a-90f4-f49f7a1b9f5b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.079964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:56.135252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.135881 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.136156 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.136426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] PATH_INFO: `/v3/projects/6eaceec629f54c6d85a0b49bde88ccc5` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.137596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eaceec629f54c6d85a0b49bde88ccc5)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.139481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:56.195854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eaceec629f54c6d85a0b49bde88ccc5', 'request_id': 'req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:56.204952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eaceec629f54c6d85a0b49bde88ccc5', 'request_id': 'req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:56.211148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eaceec629f54c6d85a0b49bde88ccc5', 'request_id': 'req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:56.222738 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] The token cache is being invalidate because project 6eaceec629f54c6d85a0b49bde88ccc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:56.223067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:56.223775 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1aa8cbfb-7850-4ba4-9a42-17a0f05b240d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:56.225368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1264/2545] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:56 2022] DELETE /identity/v3/projects/6eaceec629f54c6d85a0b49bde88ccc5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:56.230457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785526f-b168-46dd-893c-32bb29f1659f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.230969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785526f-b168-46dd-893c-32bb29f1659f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.230969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785526f-b168-46dd-893c-32bb29f1659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.253896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a785526f-b168-46dd-893c-32bb29f1659f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:56.255175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a785526f-b168-46dd-893c-32bb29f1659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:56.271992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:56.325115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1282/2546] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:56.334252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1eabe-8fd9-447a-b759-42c82608593f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.334532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1eabe-8fd9-447a-b759-42c82608593f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.334798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1eabe-8fd9-447a-b759-42c82608593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.355717 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e6a1eabe-8fd9-447a-b759-42c82608593f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:56.356906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e6a1eabe-8fd9-447a-b759-42c82608593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:56.365460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1265/2547] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:56.369977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785526f-b168-46dd-893c-32bb29f1659f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.380417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785526f-b168-46dd-893c-32bb29f1659f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.386489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.387082 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.387354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.387616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.388271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:24:56.388565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.390165 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:56.401891 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1283/2548] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:24:56.406626 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1eabe-8fd9-447a-b759-42c82608593f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.416369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1eabe-8fd9-447a-b759-42c82608593f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.422535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621783-b805-4293-b80b-37edb977d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.423241 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621783-b805-4293-b80b-37edb977d690 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.423522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621783-b805-4293-b80b-37edb977d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.423787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621783-b805-4293-b80b-37edb977d690 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.424492 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12621783-b805-4293-b80b-37edb977d690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.426498 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12621783-b805-4293-b80b-37edb977d690 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:56.457104 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1266/2549] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:56 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:56.461439 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.471669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fc3db-17ce-4fce-87ce-75915a0204a9 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.530245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e5220-ed63-4284-91a8-cc2455df2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.530853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5220-ed63-4284-91a8-cc2455df2637 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.531131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5220-ed63-4284-91a8-cc2455df2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.531402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5220-ed63-4284-91a8-cc2455df2637 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.532028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e5220-ed63-4284-91a8-cc2455df2637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.534034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e5220-ed63-4284-91a8-cc2455df2637 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:56.562159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1284/2550] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:56 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:56.564342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621783-b805-4293-b80b-37edb977d690 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.575112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621783-b805-4293-b80b-37edb977d690 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.579961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396f292-3053-45c4-8a5b-43e2a805aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.580583 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396f292-3053-45c4-8a5b-43e2a805aded admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.580862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396f292-3053-45c4-8a5b-43e2a805aded admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.581209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396f292-3053-45c4-8a5b-43e2a805aded admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.581908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396f292-3053-45c4-8a5b-43e2a805aded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.583554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396f292-3053-45c4-8a5b-43e2a805aded admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:56.594207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1267/2551] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:56.598386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e5220-ed63-4284-91a8-cc2455df2637 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.608477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e5220-ed63-4284-91a8-cc2455df2637 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.613910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab41367-9858-412b-9f37-fb0d845097ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.614517 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab41367-9858-412b-9f37-fb0d845097ad admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.614774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab41367-9858-412b-9f37-fb0d845097ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.615034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab41367-9858-412b-9f37-fb0d845097ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.615814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab41367-9858-412b-9f37-fb0d845097ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.617457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab41367-9858-412b-9f37-fb0d845097ad admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:56.629001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1285/2552] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:56.633506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396f292-3053-45c4-8a5b-43e2a805aded admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.644468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396f292-3053-45c4-8a5b-43e2a805aded admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.649716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd554fc-1935-44ef-80f9-c4f2ea68840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.650373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd554fc-1935-44ef-80f9-c4f2ea68840d admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.650651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd554fc-1935-44ef-80f9-c4f2ea68840d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.650932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd554fc-1935-44ef-80f9-c4f2ea68840d admin admin] PATH_INFO: `/v3/projects/3bee20ecdc7c45e8827f5a28398c8163/users/5f923b4b1d92472cb81a23bf6de31b25/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.667299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd554fc-1935-44ef-80f9-c4f2ea68840d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bee20ecdc7c45e8827f5a28398c8163, user_id=5f923b4b1d92472cb81a23bf6de31b25, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.670045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd554fc-1935-44ef-80f9-c4f2ea68840d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:56.687218 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1268/2553] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:56 2022] PUT /identity/v3/projects/3bee20ecdc7c45e8827f5a28398c8163/users/5f923b4b1d92472cb81a23bf6de31b25/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:56.698151 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d445ee-06ed-4005-bca7-a1206a8be144 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.698435 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d445ee-06ed-4005-bca7-a1206a8be144 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.698705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d445ee-06ed-4005-bca7-a1206a8be144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.729477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f6d445ee-06ed-4005-bca7-a1206a8be144 None None] MFA Rules not processed for user `5f923b4b1d92472cb81a23bf6de31b25`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:56.731266 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f6d445ee-06ed-4005-bca7-a1206a8be144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:56.807622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1286/2554] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:56.812285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd554fc-1935-44ef-80f9-c4f2ea68840d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.854390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:56.879118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd554fc-1935-44ef-80f9-c4f2ea68840d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.884170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab8f80-0db7-47ee-904b-6db76de7b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.884781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f80-0db7-47ee-904b-6db76de7b89b admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.885058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f80-0db7-47ee-904b-6db76de7b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.885360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8f80-0db7-47ee-904b-6db76de7b89b admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.886014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab8f80-0db7-47ee-904b-6db76de7b89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.887937 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab8f80-0db7-47ee-904b-6db76de7b89b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:56.917309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1269/2555] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:56 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:56.921574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d445ee-06ed-4005-bca7-a1206a8be144 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:56.932489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d445ee-06ed-4005-bca7-a1206a8be144 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:56.941176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:56.993492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842fb44-3543-4072-afe9-b20803522cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:56.994187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fb44-3543-4072-afe9-b20803522cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:56.994565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fb44-3543-4072-afe9-b20803522cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:56.994873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842fb44-3543-4072-afe9-b20803522cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:56.996310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842fb44-3543-4072-afe9-b20803522cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:56.997894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842fb44-3543-4072-afe9-b20803522cc1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:57.022911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1287/2556] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:56 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:24:57.027366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab8f80-0db7-47ee-904b-6db76de7b89b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:57.044004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab8f80-0db7-47ee-904b-6db76de7b89b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:57.051007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91982a-b127-4c6b-bd38-ee5235774513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:57.051917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91982a-b127-4c6b-bd38-ee5235774513 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:57.052344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91982a-b127-4c6b-bd38-ee5235774513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:57.052761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91982a-b127-4c6b-bd38-ee5235774513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:57.053829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91982a-b127-4c6b-bd38-ee5235774513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:57.056401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91982a-b127-4c6b-bd38-ee5235774513 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:57.074917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1270/2557] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:57.076390 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842fb44-3543-4072-afe9-b20803522cc1 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:57.086945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842fb44-3543-4072-afe9-b20803522cc1 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:57.091879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c29d-8894-4531-a819-5c26edc639f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:57.092604 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c29d-8894-4531-a819-5c26edc639f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:57.092992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c29d-8894-4531-a819-5c26edc639f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:57.093350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c29d-8894-4531-a819-5c26edc639f0 admin admin] PATH_INFO: `/v3/projects/ce814eb73847407baa3885a692f6fc27/users/49d93c55163e4475b72ac4755c732e29/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:57.109009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8c29d-8894-4531-a819-5c26edc639f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce814eb73847407baa3885a692f6fc27, user_id=49d93c55163e4475b72ac4755c732e29, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:57.111799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8c29d-8894-4531-a819-5c26edc639f0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:57.127859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1288/2558] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:57 2022] PUT /identity/v3/projects/ce814eb73847407baa3885a692f6fc27/users/49d93c55163e4475b72ac4755c732e29/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:57.131898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91982a-b127-4c6b-bd38-ee5235774513 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:57.142058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91982a-b127-4c6b-bd38-ee5235774513 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:57.202624 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d493f-b5d6-4401-8ff3-c6bed0bac846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:57.203244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d493f-b5d6-4401-8ff3-c6bed0bac846 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:57.203520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d493f-b5d6-4401-8ff3-c6bed0bac846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:57.203791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d493f-b5d6-4401-8ff3-c6bed0bac846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:57.204436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d493f-b5d6-4401-8ff3-c6bed0bac846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:57.206115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d493f-b5d6-4401-8ff3-c6bed0bac846 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:57.215683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1271/2559] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:57.219967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c29d-8894-4531-a819-5c26edc639f0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:57.231011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c29d-8894-4531-a819-5c26edc639f0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:57.236214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:57.236974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:57.237376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:57.237717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] PATH_INFO: `/v3/projects/ce814eb73847407baa3885a692f6fc27/users/49d93c55163e4475b72ac4755c732e29/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:57.239851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce814eb73847407baa3885a692f6fc27, user_id=49d93c55163e4475b72ac4755c732e29, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:57.242545 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:57.254087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1289/2560] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:57 2022] PUT /identity/v3/projects/ce814eb73847407baa3885a692f6fc27/users/49d93c55163e4475b72ac4755c732e29/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:57.264704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3a20-b2d3-4040-b56d-7daa8a7f8e0e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:57.264998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3a20-b2d3-4040-b56d-7daa8a7f8e0e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:57.265293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3a20-b2d3-4040-b56d-7daa8a7f8e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:57.298554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-caff3a20-b2d3-4040-b56d-7daa8a7f8e0e None None] MFA Rules not processed for user `49d93c55163e4475b72ac4755c732e29`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:57.300057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-caff3a20-b2d3-4040-b56d-7daa8a7f8e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:57.371782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1272/2561] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:57.382769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:57.384806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:57.443734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c761e1a-0261-4d24-a45d-6f8fbb155218 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:57.447514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faa0ee-c9af-4114-acf0-9317ce11b5cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:57.448124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faa0ee-c9af-4114-acf0-9317ce11b5cf service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:57.448399 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faa0ee-c9af-4114-acf0-9317ce11b5cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:57.448670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faa0ee-c9af-4114-acf0-9317ce11b5cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:57.457928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faa0ee-c9af-4114-acf0-9317ce11b5cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:57.459364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faa0ee-c9af-4114-acf0-9317ce11b5cf service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:57.469002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1290/2562] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:57.884860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff3a20-b2d3-4040-b56d-7daa8a7f8e0e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:57.919759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:57.950499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff3a20-b2d3-4040-b56d-7daa8a7f8e0e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:57.955089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:57.955754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:57.956145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:57.956625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] PATH_INFO: `/v3/users/5f923b4b1d92472cb81a23bf6de31b25` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:57.957806 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f923b4b1d92472cb81a23bf6de31b25)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:57.959746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:58.012043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f923b4b1d92472cb81a23bf6de31b25'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.025890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f923b4b1d92472cb81a23bf6de31b25'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.034130 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f923b4b1d92472cb81a23bf6de31b25'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.046826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f923b4b1d92472cb81a23bf6de31b25'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.047458 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f923b4b1d92472cb81a23bf6de31b25'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.055518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1273/2563] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:57 2022] DELETE /identity/v3/users/5f923b4b1d92472cb81a23bf6de31b25 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:58.059972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b261a-d480-4aa3-abf9-e8aef27f0ecf None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:58.060131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b261a-d480-4aa3-abf9-e8aef27f0ecf None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:58.060433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b261a-d480-4aa3-abf9-e8aef27f0ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:58.077013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:58.083066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:58.083890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a07b261a-d480-4aa3-abf9-e8aef27f0ecf None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:58.085447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a07b261a-d480-4aa3-abf9-e8aef27f0ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:58.153474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1291/2564] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:24:58.167893 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b261a-d480-4aa3-abf9-e8aef27f0ecf None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:58.169504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a07b261a-d480-4aa3-abf9-e8aef27f0ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:58.199913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3ee5-d5d6-4cfd-acac-ea99b47c5f44 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:58.206689 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:58.207609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:58.207970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:58.208690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:58.210808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:58.213588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:58.228578 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:58.230892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:58.246945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1274/2565] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:24:58.324033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b261a-d480-4aa3-abf9-e8aef27f0ecf None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:58.328694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ad8db-d855-41b7-9622-9c023b204869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:58.329768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ad8db-d855-41b7-9622-9c023b204869 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:58.330144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ad8db-d855-41b7-9622-9c023b204869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:58.330507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ad8db-d855-41b7-9622-9c023b204869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:58.346941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ad8db-d855-41b7-9622-9c023b204869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:58.348716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ad8db-d855-41b7-9622-9c023b204869 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:58.372683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1292/2566] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:24:58.656250 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:58.658776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:58.685454 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd2b35-bc3b-494c-922a-05b33ba8a93e service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:58.693686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:58.694364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:58.694646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:58.694927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] PATH_INFO: `/v3/projects/3bee20ecdc7c45e8827f5a28398c8163` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:58.696103 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bee20ecdc7c45e8827f5a28398c8163)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:58.698704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:58.744587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:58.763411 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bee20ecdc7c45e8827f5a28398c8163', 'request_id': 'req-44a062e4-a870-401c-a997-58742aa25b76'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.774279 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bee20ecdc7c45e8827f5a28398c8163', 'request_id': 'req-44a062e4-a870-401c-a997-58742aa25b76'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.781402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bee20ecdc7c45e8827f5a28398c8163', 'request_id': 'req-44a062e4-a870-401c-a997-58742aa25b76'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.795959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] The token cache is being invalidate because project 3bee20ecdc7c45e8827f5a28398c8163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:58.796958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.798334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.804295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1275/2567] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:58 2022] DELETE /identity/v3/projects/3bee20ecdc7c45e8827f5a28398c8163 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:58.804951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ad8db-d855-41b7-9622-9c023b204869 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:58.816503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ad8db-d855-41b7-9622-9c023b204869 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:58.885191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:58.886331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:58.886606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:58.886868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] PATH_INFO: `/v3/users/49d93c55163e4475b72ac4755c732e29` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:58.888010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d93c55163e4475b72ac4755c732e29)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:58.889963 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:58.940510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d93c55163e4475b72ac4755c732e29'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.941274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d93c55163e4475b72ac4755c732e29'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.953652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d93c55163e4475b72ac4755c732e29'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.961055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d93c55163e4475b72ac4755c732e29'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.972298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-0680ddeb-ade8-4d23-938b-471fa146bfce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d93c55163e4475b72ac4755c732e29'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:58.979283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1293/2568] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:24:58 2022] DELETE /identity/v3/users/49d93c55163e4475b72ac4755c732e29 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:24:59.272714 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:59.274391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:59.296332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a062e4-a870-401c-a997-58742aa25b76 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:59.354361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:59.355032 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.355309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.355582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] PATH_INFO: `/v3/projects/ce814eb73847407baa3885a692f6fc27` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.356731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce814eb73847407baa3885a692f6fc27)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:59.358731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:59.412596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce814eb73847407baa3885a692f6fc27', 'request_id': 'req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:59.420991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce814eb73847407baa3885a692f6fc27', 'request_id': 'req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:59.427848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce814eb73847407baa3885a692f6fc27', 'request_id': 'req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:59.440612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] The token cache is being invalidate because project ce814eb73847407baa3885a692f6fc27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:24:59.440906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:59.441588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a3084eda-0f13-4c3c-9b81-4b0e6c80bb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:24:59.443353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1276/2569] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:24:59 2022] DELETE /identity/v3/projects/ce814eb73847407baa3885a692f6fc27 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:24:59.449539 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff812-bf29-4a7c-82e3-1b5b8a072754 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.450078 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff812-bf29-4a7c-82e3-1b5b8a072754 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.450175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff812-bf29-4a7c-82e3-1b5b8a072754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.470925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fcaff812-bf29-4a7c-82e3-1b5b8a072754 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:59.472207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fcaff812-bf29-4a7c-82e3-1b5b8a072754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:59.498692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:59.535293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1294/2570] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:59.604056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45222ca-7481-4fc2-bf70-b71c53bf1f73 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.604337 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45222ca-7481-4fc2-bf70-b71c53bf1f73 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.604607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45222ca-7481-4fc2-bf70-b71c53bf1f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.629936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c45222ca-7481-4fc2-bf70-b71c53bf1f73 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:24:59.631208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c45222ca-7481-4fc2-bf70-b71c53bf1f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:24:59.639524 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1277/2571] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:24:59.644051 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff812-bf29-4a7c-82e3-1b5b8a072754 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:59.653951 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff812-bf29-4a7c-82e3-1b5b8a072754 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:59.659149 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:59.659490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.659775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.660044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.661182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:24:59.661182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:59.662631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:59.678825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1295/2572] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:24:59.680039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45222ca-7481-4fc2-bf70-b71c53bf1f73 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:59.690114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45222ca-7481-4fc2-bf70-b71c53bf1f73 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:59.695515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314c0c-df51-4b1b-b3f8-177f4602ac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:59.696158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314c0c-df51-4b1b-b3f8-177f4602ac4d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.696430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314c0c-df51-4b1b-b3f8-177f4602ac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.696720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81314c0c-df51-4b1b-b3f8-177f4602ac4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.697420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81314c0c-df51-4b1b-b3f8-177f4602ac4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:59.699346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81314c0c-df51-4b1b-b3f8-177f4602ac4d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:59.736127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1278/2573] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:24:59 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:24:59.737520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:59.748144 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4293e1c-b00c-4038-96f0-181e4c4f134d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:59.814066 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4c59b-d3c8-4deb-9904-89480db3865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:59.814914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4c59b-d3c8-4deb-9904-89480db3865d admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.815479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4c59b-d3c8-4deb-9904-89480db3865d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.815632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4c59b-d3c8-4deb-9904-89480db3865d admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.816304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4c59b-d3c8-4deb-9904-89480db3865d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:59.818310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4c59b-d3c8-4deb-9904-89480db3865d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:59.845815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1296/2574] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:24:59 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:24:59.847245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314c0c-df51-4b1b-b3f8-177f4602ac4d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:59.858081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81314c0c-df51-4b1b-b3f8-177f4602ac4d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:59.863278 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10048-f7dd-407e-9a9c-afb7f048fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:59.863911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10048-f7dd-407e-9a9c-afb7f048fbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.864184 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10048-f7dd-407e-9a9c-afb7f048fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.864452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de10048-f7dd-407e-9a9c-afb7f048fbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.865118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de10048-f7dd-407e-9a9c-afb7f048fbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:59.866760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de10048-f7dd-407e-9a9c-afb7f048fbf5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:59.881244 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1279/2575] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:24:59.882565 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4c59b-d3c8-4deb-9904-89480db3865d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:59.893061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4c59b-d3c8-4deb-9904-89480db3865d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:59.898156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceb5cd-8ad3-4adf-9975-dae8c5b3bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:59.898801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb5cd-8ad3-4adf-9975-dae8c5b3bbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.899080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb5cd-8ad3-4adf-9975-dae8c5b3bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.899356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceb5cd-8ad3-4adf-9975-dae8c5b3bbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.899998 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceb5cd-8ad3-4adf-9975-dae8c5b3bbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:59.901652 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceb5cd-8ad3-4adf-9975-dae8c5b3bbb2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:59.917079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1297/2576] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:24:59.918376 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10048-f7dd-407e-9a9c-afb7f048fbf5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:24:59.929770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de10048-f7dd-407e-9a9c-afb7f048fbf5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:24:59.935239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:24:59.935923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.936196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.936466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] PATH_INFO: `/v3/projects/71a1859322764c19b09116102b8d318c/users/f98251c5440a4806adc7503b566679bf/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:24:59.939970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:24:59.953930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a1859322764c19b09116102b8d318c, user_id=f98251c5440a4806adc7503b566679bf, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:24:59.956942 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:24:59.971969 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1280/2577] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:24:59 2022] PUT /identity/v3/projects/71a1859322764c19b09116102b8d318c/users/f98251c5440a4806adc7503b566679bf/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:24:59.982765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c254-0d58-4d53-a04e-4eadc2551269 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:24:59.983047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c254-0d58-4d53-a04e-4eadc2551269 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:24:59.983317 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8c254-0d58-4d53-a04e-4eadc2551269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:00.013789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0aa8c254-0d58-4d53-a04e-4eadc2551269 None None] MFA Rules not processed for user `f98251c5440a4806adc7503b566679bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:00.015270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0aa8c254-0d58-4d53-a04e-4eadc2551269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:00.091329 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1298/2578] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:00.103887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:00.105894 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:00.183094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583cedc-f209-4f23-9870-e488e8861aed admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:00.188188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:00.188840 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:00.189152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:00.189467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:00.200497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:00.202005 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:00.212310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1281/2579] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:02.751211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8c254-0d58-4d53-a04e-4eadc2551269 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:02.752671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0aa8c254-0d58-4d53-a04e-4eadc2551269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:02.786148 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:02.815850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8c254-0d58-4d53-a04e-4eadc2551269 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:02.819789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:02.820391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:02.820664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:02.820934 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:02.822855 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:02.888043 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:02.889467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:02.899529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1299/2580] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:06.040342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.042460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:06.103028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.104961 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:06.120746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6e7c3-da5c-4b13-b64b-4dacb1a0e658 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:06.125632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:06.126208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.126514 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.126774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] PATH_INFO: `/v3/users/2f0c7305f2904f9cb68d17bc3e3f5582` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.128103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0c7305f2904f9cb68d17bc3e3f5582)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:06.130134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:06.137183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85771dbd-f170-42d4-9af3-cacac50fccf6 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:06.142386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:06.143011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.143319 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.143595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.145676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:06.158240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:06.160011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:06.176688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1282/2581] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:06.192273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0c7305f2904f9cb68d17bc3e3f5582'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.193220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0c7305f2904f9cb68d17bc3e3f5582'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.205355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0c7305f2904f9cb68d17bc3e3f5582'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.213067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0c7305f2904f9cb68d17bc3e3f5582'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.223129 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c2cf6ad6-5c86-41f5-a891-4a7c211541f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0c7305f2904f9cb68d17bc3e3f5582'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.229214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1300/2582] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:06 2022] DELETE /identity/v3/users/2f0c7305f2904f9cb68d17bc3e3f5582 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:06.408642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.420178 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a03777-9483-4e50-81a2-5bf5bec0d759 service placement] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:06.482318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:06.482963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.483240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.483496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] PATH_INFO: `/v3/projects/1c174bb7b7e540b9b05832c44cae3178` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.484699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c174bb7b7e540b9b05832c44cae3178)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:06.486684 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:06.510252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:06.544610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c174bb7b7e540b9b05832c44cae3178', 'request_id': 'req-25e7ed56-fefb-46d0-9348-b6e39f12ea99'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.554511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c174bb7b7e540b9b05832c44cae3178', 'request_id': 'req-25e7ed56-fefb-46d0-9348-b6e39f12ea99'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.560377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c174bb7b7e540b9b05832c44cae3178', 'request_id': 'req-25e7ed56-fefb-46d0-9348-b6e39f12ea99'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.571931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] The token cache is being invalidate because project 1c174bb7b7e540b9b05832c44cae3178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:06.572220 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.572931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-25e7ed56-fefb-46d0-9348-b6e39f12ea99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:06.574547 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1283/2583] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:06 2022] DELETE /identity/v3/projects/1c174bb7b7e540b9b05832c44cae3178 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:06.579886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01a029-ee06-4b4a-bd65-46b47deeb1bc None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.580344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01a029-ee06-4b4a-bd65-46b47deeb1bc None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.580647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01a029-ee06-4b4a-bd65-46b47deeb1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.604237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-5a01a029-ee06-4b4a-bd65-46b47deeb1bc None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:06.605484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-5a01a029-ee06-4b4a-bd65-46b47deeb1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:06.652933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:06.671023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1301/2584] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:06.679952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058b81-5d0a-4bb4-a80e-07e2ab868267 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.680259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058b81-5d0a-4bb4-a80e-07e2ab868267 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.680535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a058b81-5d0a-4bb4-a80e-07e2ab868267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.701151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4a058b81-5d0a-4bb4-a80e-07e2ab868267 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:06.702388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4a058b81-5d0a-4bb4-a80e-07e2ab868267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:06.710931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1284/2585] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:25:06.715354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01a029-ee06-4b4a-bd65-46b47deeb1bc None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.726365 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01a029-ee06-4b4a-bd65-46b47deeb1bc None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:06.731603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:06.732217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.732496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.732768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.733470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:25:06.733785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:06.735406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:06.747980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1302/2586] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:25:06.752421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a058b81-5d0a-4bb4-a80e-07e2ab868267 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.762574 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a058b81-5d0a-4bb4-a80e-07e2ab868267 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:06.767221 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cbe8e-0b07-475c-8b45-3d5e9f40c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:06.767844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbe8e-0b07-475c-8b45-3d5e9f40c978 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.768125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbe8e-0b07-475c-8b45-3d5e9f40c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.768396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbe8e-0b07-475c-8b45-3d5e9f40c978 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.769259 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cbe8e-0b07-475c-8b45-3d5e9f40c978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:06.771329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cbe8e-0b07-475c-8b45-3d5e9f40c978 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:06.800861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1285/2587] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:25:06 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:06.805634 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.820668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bd105-fbe6-4757-bf75-f0cf490f3ae4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:06.883472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a41c6-748e-4b69-80f4-505c12376dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:06.884070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a41c6-748e-4b69-80f4-505c12376dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.884345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a41c6-748e-4b69-80f4-505c12376dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.884611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a41c6-748e-4b69-80f4-505c12376dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.885288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a41c6-748e-4b69-80f4-505c12376dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:06.887208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a41c6-748e-4b69-80f4-505c12376dd5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:06.909922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1303/2588] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:25:06 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:06.914556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cbe8e-0b07-475c-8b45-3d5e9f40c978 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.924958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cbe8e-0b07-475c-8b45-3d5e9f40c978 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:06.930046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e17654-af2e-4809-978d-4a7f74f17c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:06.930654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17654-af2e-4809-978d-4a7f74f17c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.930933 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17654-af2e-4809-978d-4a7f74f17c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.931203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17654-af2e-4809-978d-4a7f74f17c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.931853 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e17654-af2e-4809-978d-4a7f74f17c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:06.933516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e17654-af2e-4809-978d-4a7f74f17c8f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:06.944575 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1286/2589] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:06.949247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a41c6-748e-4b69-80f4-505c12376dd5 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.960396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a41c6-748e-4b69-80f4-505c12376dd5 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:06.965698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83042594-5ec4-4315-aa9d-dd7b9341fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:06.966212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83042594-5ec4-4315-aa9d-dd7b9341fc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:06.966489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83042594-5ec4-4315-aa9d-dd7b9341fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:06.966763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83042594-5ec4-4315-aa9d-dd7b9341fc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:06.967532 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83042594-5ec4-4315-aa9d-dd7b9341fc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:06.969120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83042594-5ec4-4315-aa9d-dd7b9341fc57 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:06.980430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1304/2590] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:06.984904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e17654-af2e-4809-978d-4a7f74f17c8f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:06.996318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e17654-af2e-4809-978d-4a7f74f17c8f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:07.001114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:07.001824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:07.002075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:07.002346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] PATH_INFO: `/v3/projects/54808f290d9e4ae3954fcb82556a0054/users/7d24364303a94232adb4fc5dab0c507b/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:07.020805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54808f290d9e4ae3954fcb82556a0054, user_id=7d24364303a94232adb4fc5dab0c507b, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:07.023555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:07.039442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1287/2591] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:06 2022] PUT /identity/v3/projects/54808f290d9e4ae3954fcb82556a0054/users/7d24364303a94232adb4fc5dab0c507b/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:07.050857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899282-d8a1-49d0-a615-a02996b8445a None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:07.051278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899282-d8a1-49d0-a615-a02996b8445a None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:07.051555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899282-d8a1-49d0-a615-a02996b8445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:07.081985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-76899282-d8a1-49d0-a615-a02996b8445a None None] MFA Rules not processed for user `7d24364303a94232adb4fc5dab0c507b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:07.083301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-76899282-d8a1-49d0-a615-a02996b8445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:07.155270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1305/2592] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:07.167904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:07.169973 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:07.233620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60518280-9b35-4484-8892-6cf103f70861 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:07.237393 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da424ad-899d-4ffd-ba71-00588781b039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:07.238674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da424ad-899d-4ffd-ba71-00588781b039 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:07.238986 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da424ad-899d-4ffd-ba71-00588781b039 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:07.239223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da424ad-899d-4ffd-ba71-00588781b039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:07.247619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da424ad-899d-4ffd-ba71-00588781b039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:07.249059 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da424ad-899d-4ffd-ba71-00588781b039 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:07.257982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1288/2593] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:15.777260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899282-d8a1-49d0-a615-a02996b8445a None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:15.833630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:15.855093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899282-d8a1-49d0-a615-a02996b8445a None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:15.860536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:15.861326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:15.861677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:15.862057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] PATH_INFO: `/v3/users/7d24364303a94232adb4fc5dab0c507b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:15.863401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d24364303a94232adb4fc5dab0c507b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:15.865635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:15.930490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d24364303a94232adb4fc5dab0c507b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:15.931733 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d24364303a94232adb4fc5dab0c507b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:15.952766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d24364303a94232adb4fc5dab0c507b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:15.961723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d24364303a94232adb4fc5dab0c507b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:15.971181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d24364303a94232adb4fc5dab0c507b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:15.978431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1306/2594] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:15 2022] DELETE /identity/v3/users/7d24364303a94232adb4fc5dab0c507b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:15.983311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09550ef0-5c86-4d34-b02e-748f2e485663 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:15.983900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09550ef0-5c86-4d34-b02e-748f2e485663 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:15.983900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09550ef0-5c86-4d34-b02e-748f2e485663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.004922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-09550ef0-5c86-4d34-b02e-748f2e485663 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:16.006210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-09550ef0-5c86-4d34-b02e-748f2e485663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:16.055582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:16.072688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1289/2595] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:16.083074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:16.084611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:16.147664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312114cd-b204-476f-be2d-50088490a21b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:16.151702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd85309-f494-4061-a59d-fb2c5b86c30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:16.152249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd85309-f494-4061-a59d-fb2c5b86c30d service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:16.152525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd85309-f494-4061-a59d-fb2c5b86c30d service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:16.152898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd85309-f494-4061-a59d-fb2c5b86c30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.163701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd85309-f494-4061-a59d-fb2c5b86c30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:16.166071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd85309-f494-4061-a59d-fb2c5b86c30d service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:16.183719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1307/2596] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:16.487307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09550ef0-5c86-4d34-b02e-748f2e485663 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:16.488924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-09550ef0-5c86-4d34-b02e-748f2e485663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:16.503905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09550ef0-5c86-4d34-b02e-748f2e485663 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:16.510475 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:16.511171 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:16.511451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:16.511780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] PATH_INFO: `/v3/projects/54808f290d9e4ae3954fcb82556a0054` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.513197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=54808f290d9e4ae3954fcb82556a0054)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:16.515596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:16.582930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54808f290d9e4ae3954fcb82556a0054', 'request_id': 'req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:16.593287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54808f290d9e4ae3954fcb82556a0054', 'request_id': 'req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:16.600044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54808f290d9e4ae3954fcb82556a0054', 'request_id': 'req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:16.613183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] The token cache is being invalidate because project 54808f290d9e4ae3954fcb82556a0054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:16.613695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:16.614377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b9c24173-8bf8-4c25-88c0-7cdcd324a1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:16.615906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1290/2597] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:16 2022] DELETE /identity/v3/projects/54808f290d9e4ae3954fcb82556a0054 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:16.621056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979328-dbb3-443e-9c3d-21eb9527dd19 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:16.621512 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979328-dbb3-443e-9c3d-21eb9527dd19 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:16.621863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979328-dbb3-443e-9c3d-21eb9527dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.641683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-01979328-dbb3-443e-9c3d-21eb9527dd19 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:16.642920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-01979328-dbb3-443e-9c3d-21eb9527dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:16.708942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1308/2598] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:16.717076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec915e-d20a-4017-a111-4b4465fda73c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:16.717385 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec915e-d20a-4017-a111-4b4465fda73c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:16.717660 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec915e-d20a-4017-a111-4b4465fda73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.741234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e3ec915e-d20a-4017-a111-4b4465fda73c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:16.742466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e3ec915e-d20a-4017-a111-4b4465fda73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:16.750746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1291/2599] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:16.755028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01979328-dbb3-443e-9c3d-21eb9527dd19 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:16.764882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01979328-dbb3-443e-9c3d-21eb9527dd19 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:16.769927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:16.770559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:16.770803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:16.771073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.771729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:25:16.772028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:16.773671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:16.775428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:16.787730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1309/2600] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:25:16.792023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec915e-d20a-4017-a111-4b4465fda73c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:16.802882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec915e-d20a-4017-a111-4b4465fda73c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:16.809152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa990-3016-4e21-9fd7-06cb61364354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:16.809801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa990-3016-4e21-9fd7-06cb61364354 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:16.810075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa990-3016-4e21-9fd7-06cb61364354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:16.810334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa990-3016-4e21-9fd7-06cb61364354 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.810977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fa990-3016-4e21-9fd7-06cb61364354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:16.812878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fa990-3016-4e21-9fd7-06cb61364354 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:16.845435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1292/2601] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:25:16 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:16.850265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:16.861782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df106e82-f6b1-4122-af10-5aadfbc4364d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:16.923282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8302a2-c58d-43c0-b83e-5fcd6fe38d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:16.923889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8302a2-c58d-43c0-b83e-5fcd6fe38d50 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:16.924169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8302a2-c58d-43c0-b83e-5fcd6fe38d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:16.924444 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8302a2-c58d-43c0-b83e-5fcd6fe38d50 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.925117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8302a2-c58d-43c0-b83e-5fcd6fe38d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:16.927138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8302a2-c58d-43c0-b83e-5fcd6fe38d50 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:16.950349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1310/2602] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:25:16 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:25:16.954546 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa990-3016-4e21-9fd7-06cb61364354 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:16.966257 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa990-3016-4e21-9fd7-06cb61364354 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:16.971447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bc798-696b-45fb-9466-b3c428673640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:16.972099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bc798-696b-45fb-9466-b3c428673640 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:16.972373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bc798-696b-45fb-9466-b3c428673640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:16.972646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bc798-696b-45fb-9466-b3c428673640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:16.973312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bc798-696b-45fb-9466-b3c428673640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:16.975026 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bc798-696b-45fb-9466-b3c428673640 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:16.985664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1293/2603] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:16.990498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8302a2-c58d-43c0-b83e-5fcd6fe38d50 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:17.005501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8302a2-c58d-43c0-b83e-5fcd6fe38d50 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:17.010630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31adb2-9a25-4a1e-92ee-66f268bc1931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:17.011237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31adb2-9a25-4a1e-92ee-66f268bc1931 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:17.011515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31adb2-9a25-4a1e-92ee-66f268bc1931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:17.011787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31adb2-9a25-4a1e-92ee-66f268bc1931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:17.012493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31adb2-9a25-4a1e-92ee-66f268bc1931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:17.014461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31adb2-9a25-4a1e-92ee-66f268bc1931 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:17.026257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1311/2604] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:17.030980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bc798-696b-45fb-9466-b3c428673640 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:17.041572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bc798-696b-45fb-9466-b3c428673640 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:17.047008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:17.047673 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:17.047948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:17.048223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] PATH_INFO: `/v3/projects/6bdaf9c6c6304a86811e657036ec1165/users/f7dddfd2ca9d4d07a1db1e48a93c109a/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:17.064639 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdaf9c6c6304a86811e657036ec1165, user_id=f7dddfd2ca9d4d07a1db1e48a93c109a, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:17.067607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:17.083905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1294/2605] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:17 2022] PUT /identity/v3/projects/6bdaf9c6c6304a86811e657036ec1165/users/f7dddfd2ca9d4d07a1db1e48a93c109a/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:17.089225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66217b-8f67-420e-92c4-166905e3f1c3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:17.089484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66217b-8f67-420e-92c4-166905e3f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:17.089786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66217b-8f67-420e-92c4-166905e3f1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:17.110319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9f66217b-8f67-420e-92c4-166905e3f1c3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:17.111523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9f66217b-8f67-420e-92c4-166905e3f1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:17.175259 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1312/2606] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:17.185672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:17.187664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:17.261716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df4c63-01fa-4388-82c8-3d129d076636 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:17.266460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bf2c1-dfdf-435f-8323-69eb91a5e80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:17.267068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf2c1-dfdf-435f-8323-69eb91a5e80e service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:17.267364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf2c1-dfdf-435f-8323-69eb91a5e80e service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:17.267652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bf2c1-dfdf-435f-8323-69eb91a5e80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:17.280555 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bf2c1-dfdf-435f-8323-69eb91a5e80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:17.282049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bf2c1-dfdf-435f-8323-69eb91a5e80e service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:17.292037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1295/2607] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:25:17.976738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7e00c-7359-474c-b293-db46c5627c96 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:17.977303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7e00c-7359-474c-b293-db46c5627c96 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:17.977303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7e00c-7359-474c-b293-db46c5627c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:18.009924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fea7e00c-7359-474c-b293-db46c5627c96 None None] MFA Rules not processed for user `f7dddfd2ca9d4d07a1db1e48a93c109a`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:18.011238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fea7e00c-7359-474c-b293-db46c5627c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:18.099641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1313/2608] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:18.104288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bf2c1-dfdf-435f-8323-69eb91a5e80e service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:18.114462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bf2c1-dfdf-435f-8323-69eb91a5e80e service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:18.119003 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5ad70-cdf2-4c38-aa95-5bf2aff2a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:18.119603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5ad70-cdf2-4c38-aa95-5bf2aff2a44d admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:18.119876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5ad70-cdf2-4c38-aa95-5bf2aff2a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:18.120139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5ad70-cdf2-4c38-aa95-5bf2aff2a44d admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:18.120763 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5ad70-cdf2-4c38-aa95-5bf2aff2a44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:18.123024 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5ad70-cdf2-4c38-aa95-5bf2aff2a44d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:18.129056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:18.158494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1296/2609] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:25:18 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:18.162723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7e00c-7359-474c-b293-db46c5627c96 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:18.169428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:18.177549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7e00c-7359-474c-b293-db46c5627c96 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:18.240568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037c02c-e290-4d8c-a36d-0b7ab44d5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:18.241262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037c02c-e290-4d8c-a36d-0b7ab44d5be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:18.241549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037c02c-e290-4d8c-a36d-0b7ab44d5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:18.241827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037c02c-e290-4d8c-a36d-0b7ab44d5be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:18.242507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037c02c-e290-4d8c-a36d-0b7ab44d5be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:18.244429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037c02c-e290-4d8c-a36d-0b7ab44d5be3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:18.273658 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1314/2610] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:25:18 2022] POST /identity/v3/users => generated 308 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:18.278099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5ad70-cdf2-4c38-aa95-5bf2aff2a44d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:18.289883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5ad70-cdf2-4c38-aa95-5bf2aff2a44d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:18.295672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daccd8-dccd-46f0-b7fc-dcb250bc4884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:18.296288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daccd8-dccd-46f0-b7fc-dcb250bc4884 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:18.296567 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daccd8-dccd-46f0-b7fc-dcb250bc4884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:18.296834 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daccd8-dccd-46f0-b7fc-dcb250bc4884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:18.297527 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daccd8-dccd-46f0-b7fc-dcb250bc4884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:18.299336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daccd8-dccd-46f0-b7fc-dcb250bc4884 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:18.310590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1297/2611] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:18.315211 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037c02c-e290-4d8c-a36d-0b7ab44d5be3 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:18.326126 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037c02c-e290-4d8c-a36d-0b7ab44d5be3 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:18.331554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140012d-f0b7-45fc-a1a1-003bb2a2324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:18.332377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140012d-f0b7-45fc-a1a1-003bb2a2324b admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:18.332601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140012d-f0b7-45fc-a1a1-003bb2a2324b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:18.332892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140012d-f0b7-45fc-a1a1-003bb2a2324b admin admin] PATH_INFO: `/v3/projects/5c06b7777c8f4c6eaa5fde4c588e69eb/users/e52844593d294bb88f0e05f241b1d181/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:18.349797 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140012d-f0b7-45fc-a1a1-003bb2a2324b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c06b7777c8f4c6eaa5fde4c588e69eb, user_id=e52844593d294bb88f0e05f241b1d181, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:18.352433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140012d-f0b7-45fc-a1a1-003bb2a2324b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:18.368062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1315/2612] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:18 2022] PUT /identity/v3/projects/5c06b7777c8f4c6eaa5fde4c588e69eb/users/e52844593d294bb88f0e05f241b1d181/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:18.374017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daccd8-dccd-46f0-b7fc-dcb250bc4884 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:18.384309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daccd8-dccd-46f0-b7fc-dcb250bc4884 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:18.444335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e565a45-ce53-4f5e-95c4-4834ee97da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:18.444959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565a45-ce53-4f5e-95c4-4834ee97da09 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:18.445267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565a45-ce53-4f5e-95c4-4834ee97da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:18.445531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565a45-ce53-4f5e-95c4-4834ee97da09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:18.446173 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e565a45-ce53-4f5e-95c4-4834ee97da09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:18.448028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e565a45-ce53-4f5e-95c4-4834ee97da09 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:18.459521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1298/2613] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:18.464203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140012d-f0b7-45fc-a1a1-003bb2a2324b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:18.475235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140012d-f0b7-45fc-a1a1-003bb2a2324b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:18.480467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a44bd-fe42-4ecf-a38f-75a344623690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:18.481197 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a44bd-fe42-4ecf-a38f-75a344623690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:18.481480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a44bd-fe42-4ecf-a38f-75a344623690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:18.481781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a44bd-fe42-4ecf-a38f-75a344623690 admin admin] PATH_INFO: `/v3/projects/5c06b7777c8f4c6eaa5fde4c588e69eb/users/e52844593d294bb88f0e05f241b1d181/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:18.483745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a44bd-fe42-4ecf-a38f-75a344623690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c06b7777c8f4c6eaa5fde4c588e69eb, user_id=e52844593d294bb88f0e05f241b1d181, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:18.486398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a44bd-fe42-4ecf-a38f-75a344623690 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:18.498533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1316/2614] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:18 2022] PUT /identity/v3/projects/5c06b7777c8f4c6eaa5fde4c588e69eb/users/e52844593d294bb88f0e05f241b1d181/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:25:19.308360 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc6fc-9c2a-4db2-98ba-ad60291ac17a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:19.308944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc6fc-9c2a-4db2-98ba-ad60291ac17a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:19.309364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cc6fc-9c2a-4db2-98ba-ad60291ac17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:19.342919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-165cc6fc-9c2a-4db2-98ba-ad60291ac17a None None] MFA Rules not processed for user `e52844593d294bb88f0e05f241b1d181`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:19.344074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-165cc6fc-9c2a-4db2-98ba-ad60291ac17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:19.420069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1299/2615] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:20.527200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a44bd-fe42-4ecf-a38f-75a344623690 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:20.599339 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a44bd-fe42-4ecf-a38f-75a344623690 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:20.605258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:20.605901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:20.606179 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:20.606546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] PATH_INFO: `/v3/users/f7dddfd2ca9d4d07a1db1e48a93c109a` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:20.607743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dddfd2ca9d4d07a1db1e48a93c109a)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:20.609929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:20.666354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dddfd2ca9d4d07a1db1e48a93c109a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:20.666985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dddfd2ca9d4d07a1db1e48a93c109a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:20.674692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:20.681153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dddfd2ca9d4d07a1db1e48a93c109a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:20.689452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dddfd2ca9d4d07a1db1e48a93c109a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:20.697995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dddfd2ca9d4d07a1db1e48a93c109a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:20.705373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1317/2616] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:20 2022] DELETE /identity/v3/users/f7dddfd2ca9d4d07a1db1e48a93c109a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:20.897617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cc6fc-9c2a-4db2-98ba-ad60291ac17a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:20.915186 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cc6fc-9c2a-4db2-98ba-ad60291ac17a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:20.973348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:20.980446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:20.981263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:20.981715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:20.982143 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] PATH_INFO: `/v3/projects/6bdaf9c6c6304a86811e657036ec1165` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:20.983456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdaf9c6c6304a86811e657036ec1165)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:20.985443 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:21.039473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdaf9c6c6304a86811e657036ec1165', 'request_id': 'req-a2659b9b-ceab-435d-96ef-61e0955c2ff4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.054099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdaf9c6c6304a86811e657036ec1165', 'request_id': 'req-a2659b9b-ceab-435d-96ef-61e0955c2ff4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.061614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdaf9c6c6304a86811e657036ec1165', 'request_id': 'req-a2659b9b-ceab-435d-96ef-61e0955c2ff4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.073114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] The token cache is being invalidate because project 6bdaf9c6c6304a86811e657036ec1165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:21.073430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.074249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.076127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1300/2617] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:20 2022] DELETE /identity/v3/projects/6bdaf9c6c6304a86811e657036ec1165 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:21.080401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:21.081905 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:21.096109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dbb34-3979-497d-acd8-9980c15150f0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:21.162542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:21.163170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:21.163447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:21.163775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] PATH_INFO: `/v3/users/e52844593d294bb88f0e05f241b1d181` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:21.164907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52844593d294bb88f0e05f241b1d181)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:21.166937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:21.228617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52844593d294bb88f0e05f241b1d181'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.229320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52844593d294bb88f0e05f241b1d181'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.244306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52844593d294bb88f0e05f241b1d181'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.252171 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52844593d294bb88f0e05f241b1d181'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.261822 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-da0640ba-0972-4b10-936e-2dcbf064bcb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52844593d294bb88f0e05f241b1d181'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.267881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1318/2618] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:21 2022] DELETE /identity/v3/users/e52844593d294bb88f0e05f241b1d181 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:21.450511 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:21.452107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:21.478916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2659b9b-ceab-435d-96ef-61e0955c2ff4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:21.546104 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:21.546755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:21.547031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:21.547302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] PATH_INFO: `/v3/projects/5c06b7777c8f4c6eaa5fde4c588e69eb` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:21.548435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c06b7777c8f4c6eaa5fde4c588e69eb)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:21.550366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:21.607640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c06b7777c8f4c6eaa5fde4c588e69eb', 'request_id': 'req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.621111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c06b7777c8f4c6eaa5fde4c588e69eb', 'request_id': 'req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.629294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c06b7777c8f4c6eaa5fde4c588e69eb', 'request_id': 'req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.641773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] The token cache is being invalidate because project 5c06b7777c8f4c6eaa5fde4c588e69eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:21.642073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.643007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-b4f0cf16-94d7-45f5-8f1c-75bf0f899579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:21.644849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1301/2619] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:21 2022] DELETE /identity/v3/projects/5c06b7777c8f4c6eaa5fde4c588e69eb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:21.650073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e75514-e0cb-48c9-ab9a-10ea2c3e2c7b None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:21.650602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e75514-e0cb-48c9-ab9a-10ea2c3e2c7b None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:21.650602 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e75514-e0cb-48c9-ab9a-10ea2c3e2c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:21.672621 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-47e75514-e0cb-48c9-ab9a-10ea2c3e2c7b None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:21.673858 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-47e75514-e0cb-48c9-ab9a-10ea2c3e2c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:21.725994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:21.742115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1319/2620] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:21.750380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d8ae-4a49-45f3-bc30-9e251b9cf55e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:21.750669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d8ae-4a49-45f3-bc30-9e251b9cf55e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:21.750946 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d8ae-4a49-45f3-bc30-9e251b9cf55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:21.773456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3d56d8ae-4a49-45f3-bc30-9e251b9cf55e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:21.774680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3d56d8ae-4a49-45f3-bc30-9e251b9cf55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:21.784002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1302/2621] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:21.788616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e75514-e0cb-48c9-ab9a-10ea2c3e2c7b None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:21.799177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e75514-e0cb-48c9-ab9a-10ea2c3e2c7b None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:21.804495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:21.805124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:21.805433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:21.805698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:21.806351 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:25:21.806647 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:21.808225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:21.824717 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1320/2622] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:25:21.826176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d8ae-4a49-45f3-bc30-9e251b9cf55e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:21.836150 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d8ae-4a49-45f3-bc30-9e251b9cf55e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:21.843911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be30310-778f-4ca1-a0fd-a28cb7d837b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:21.844699 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be30310-778f-4ca1-a0fd-a28cb7d837b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:21.844997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be30310-778f-4ca1-a0fd-a28cb7d837b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:21.845292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be30310-778f-4ca1-a0fd-a28cb7d837b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:21.845961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be30310-778f-4ca1-a0fd-a28cb7d837b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:21.847915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be30310-778f-4ca1-a0fd-a28cb7d837b7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:21.858151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:21.885592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1303/2623] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:25:21 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:21.888049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:21.900471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d357ad8-6b83-4b3e-ba79-3cfbafb20196 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:21.970349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4302-5b66-4c24-982a-f2a431cb2514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:21.970958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4302-5b66-4c24-982a-f2a431cb2514 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:21.971234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4302-5b66-4c24-982a-f2a431cb2514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:21.971504 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4302-5b66-4c24-982a-f2a431cb2514 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:21.972128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4302-5b66-4c24-982a-f2a431cb2514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:21.974334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4302-5b66-4c24-982a-f2a431cb2514 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.001242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1321/2624] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:25:21 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:22.005688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be30310-778f-4ca1-a0fd-a28cb7d837b7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.016868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be30310-778f-4ca1-a0fd-a28cb7d837b7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.022203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa4d22-092b-42e5-808d-f2f46931cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.022801 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4d22-092b-42e5-808d-f2f46931cf73 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.023072 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4d22-092b-42e5-808d-f2f46931cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.023337 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa4d22-092b-42e5-808d-f2f46931cf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.023979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa4d22-092b-42e5-808d-f2f46931cf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.025613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa4d22-092b-42e5-808d-f2f46931cf73 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.036065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1304/2625] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:22.040343 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4302-5b66-4c24-982a-f2a431cb2514 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.051789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4302-5b66-4c24-982a-f2a431cb2514 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.058083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a3d04-5ea4-4687-94df-f59d8b6df4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.058688 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3d04-5ea4-4687-94df-f59d8b6df4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.059001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3d04-5ea4-4687-94df-f59d8b6df4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.059344 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a3d04-5ea4-4687-94df-f59d8b6df4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.059995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a3d04-5ea4-4687-94df-f59d8b6df4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.061638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a3d04-5ea4-4687-94df-f59d8b6df4fe admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.072751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1322/2626] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:22.077568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa4d22-092b-42e5-808d-f2f46931cf73 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.087640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa4d22-092b-42e5-808d-f2f46931cf73 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.093551 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef27eed-f864-4e22-8df1-432436d908c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.094207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef27eed-f864-4e22-8df1-432436d908c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.094452 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef27eed-f864-4e22-8df1-432436d908c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.094741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef27eed-f864-4e22-8df1-432436d908c5 admin admin] PATH_INFO: `/v3/projects/72d232f664ef45b3a9a754b37430b602/users/7087b0f5a5064604ae8d13cfc4b7f03e/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.241172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef27eed-f864-4e22-8df1-432436d908c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d232f664ef45b3a9a754b37430b602, user_id=7087b0f5a5064604ae8d13cfc4b7f03e, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.243750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef27eed-f864-4e22-8df1-432436d908c5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.258950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1305/2627] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:22 2022] PUT /identity/v3/projects/72d232f664ef45b3a9a754b37430b602/users/7087b0f5a5064604ae8d13cfc4b7f03e/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:22.270470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d962-c2a9-4f82-8b73-06b5611e17e7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.270773 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d962-c2a9-4f82-8b73-06b5611e17e7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.271030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d962-c2a9-4f82-8b73-06b5611e17e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.303238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-e433d962-c2a9-4f82-8b73-06b5611e17e7 None None] MFA Rules not processed for user `7087b0f5a5064604ae8d13cfc4b7f03e`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:22.304458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e433d962-c2a9-4f82-8b73-06b5611e17e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:22.383073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1323/2628] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:22.384746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef27eed-f864-4e22-8df1-432436d908c5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.449966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef27eed-f864-4e22-8df1-432436d908c5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.455826 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15e322-f7b1-46a7-9227-2f1a05d6e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.456426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15e322-f7b1-46a7-9227-2f1a05d6e7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.456698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15e322-f7b1-46a7-9227-2f1a05d6e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.456959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15e322-f7b1-46a7-9227-2f1a05d6e7e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.457609 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15e322-f7b1-46a7-9227-2f1a05d6e7e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.459478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15e322-f7b1-46a7-9227-2f1a05d6e7e7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.489573 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1306/2629] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:25:22 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:22.494058 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433d962-c2a9-4f82-8b73-06b5611e17e7 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.505921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433d962-c2a9-4f82-8b73-06b5611e17e7 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.554106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:22.573967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b75eda-33e7-4ec0-a0b2-da37e9c25607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.574927 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b75eda-33e7-4ec0-a0b2-da37e9c25607 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.575268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b75eda-33e7-4ec0-a0b2-da37e9c25607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.575430 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b75eda-33e7-4ec0-a0b2-da37e9c25607 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.576107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b75eda-33e7-4ec0-a0b2-da37e9c25607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.578081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b75eda-33e7-4ec0-a0b2-da37e9c25607 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.605635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1324/2630] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:25:22 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:22.610477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15e322-f7b1-46a7-9227-2f1a05d6e7e7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.624317 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15e322-f7b1-46a7-9227-2f1a05d6e7e7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.632249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f4635-6056-4d8f-8dbf-702707a2e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.632886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4635-6056-4d8f-8dbf-702707a2e806 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.633202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4635-6056-4d8f-8dbf-702707a2e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.633468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4635-6056-4d8f-8dbf-702707a2e806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.634112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f4635-6056-4d8f-8dbf-702707a2e806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.635766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f4635-6056-4d8f-8dbf-702707a2e806 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.646697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1307/2631] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:22.651193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b75eda-33e7-4ec0-a0b2-da37e9c25607 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.662327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b75eda-33e7-4ec0-a0b2-da37e9c25607 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.667331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8e31-70ce-4ea7-a589-4f13e5713abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.668064 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8e31-70ce-4ea7-a589-4f13e5713abe admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.668769 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8e31-70ce-4ea7-a589-4f13e5713abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.669299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d8e31-70ce-4ea7-a589-4f13e5713abe admin admin] PATH_INFO: `/v3/projects/2e3c469a1c644c14b8aad6eb6ff21b7b/users/c02cf56c98414b32b204bfc08540626c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.684663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d8e31-70ce-4ea7-a589-4f13e5713abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3c469a1c644c14b8aad6eb6ff21b7b, user_id=c02cf56c98414b32b204bfc08540626c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.687524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d8e31-70ce-4ea7-a589-4f13e5713abe admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.703466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1325/2632] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:22 2022] PUT /identity/v3/projects/2e3c469a1c644c14b8aad6eb6ff21b7b/users/c02cf56c98414b32b204bfc08540626c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:22.707423 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f4635-6056-4d8f-8dbf-702707a2e806 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.718387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f4635-6056-4d8f-8dbf-702707a2e806 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.794923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c437115-b985-452d-9ce3-90b76b49628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.794923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c437115-b985-452d-9ce3-90b76b49628d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.795239 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c437115-b985-452d-9ce3-90b76b49628d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.795365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c437115-b985-452d-9ce3-90b76b49628d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.795941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c437115-b985-452d-9ce3-90b76b49628d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.797550 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c437115-b985-452d-9ce3-90b76b49628d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.811246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1308/2633] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:22.815726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8e31-70ce-4ea7-a589-4f13e5713abe admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:22.828010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d8e31-70ce-4ea7-a589-4f13e5713abe admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:22.834578 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:22.835245 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.835520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.835786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] PATH_INFO: `/v3/projects/2e3c469a1c644c14b8aad6eb6ff21b7b/users/c02cf56c98414b32b204bfc08540626c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.837787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3c469a1c644c14b8aad6eb6ff21b7b, user_id=c02cf56c98414b32b204bfc08540626c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:22.840434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:22.852331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1326/2634] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:22 2022] PUT /identity/v3/projects/2e3c469a1c644c14b8aad6eb6ff21b7b/users/c02cf56c98414b32b204bfc08540626c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:22.863847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0293b-2305-4f04-9f40-38cedf26e8ac None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:22.864124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0293b-2305-4f04-9f40-38cedf26e8ac None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:22.864390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0293b-2305-4f04-9f40-38cedf26e8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:22.899473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f1b0293b-2305-4f04-9f40-38cedf26e8ac None None] MFA Rules not processed for user `c02cf56c98414b32b204bfc08540626c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:22.900521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f1b0293b-2305-4f04-9f40-38cedf26e8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:22.918848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:23.010851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1309/2635] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:23.024547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:23.026311 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:23.108207 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f79e18-ea06-4140-b84e-b3543d677458 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:23.112357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:23.113046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:23.113582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:23.113785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:23.123698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:23.125304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:23.136672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1327/2636] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:23.229392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0293b-2305-4f04-9f40-38cedf26e8ac None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:23.240482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0293b-2305-4f04-9f40-38cedf26e8ac None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:23.244950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc4d41-8c3c-44b2-bfe8-2b96ee936132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:23.245597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc4d41-8c3c-44b2-bfe8-2b96ee936132 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:23.245847 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc4d41-8c3c-44b2-bfe8-2b96ee936132 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:23.246192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc4d41-8c3c-44b2-bfe8-2b96ee936132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:23.313865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc4d41-8c3c-44b2-bfe8-2b96ee936132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:23.318472 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc4d41-8c3c-44b2-bfe8-2b96ee936132 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:23.329133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1310/2637] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:30.580009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:30.581745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:30.651140 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dd0c7-9ab3-4d7d-a8ee-652dd26eff70 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:30.656664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:30.657319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:30.657609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:30.657972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] PATH_INFO: `/v3/users/f98251c5440a4806adc7503b566679bf` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:30.659026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98251c5440a4806adc7503b566679bf)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:30.660907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:30.708349 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:30.713572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98251c5440a4806adc7503b566679bf'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:30.714679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98251c5440a4806adc7503b566679bf'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:30.727766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98251c5440a4806adc7503b566679bf'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:30.735496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98251c5440a4806adc7503b566679bf'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:30.743685 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98251c5440a4806adc7503b566679bf'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:30.751402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1328/2638] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:30 2022] DELETE /identity/v3/users/f98251c5440a4806adc7503b566679bf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:30.756132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92ba6-397b-4735-bf9d-f9c7850f34f5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:30.756608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92ba6-397b-4735-bf9d-f9c7850f34f5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:30.756707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92ba6-397b-4735-bf9d-f9c7850f34f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:30.777009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a9f92ba6-397b-4735-bf9d-f9c7850f34f5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:30.778274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a9f92ba6-397b-4735-bf9d-f9c7850f34f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:30.841999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1311/2639] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:30.852403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:30.854401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:30.919569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517c5bc-e0a4-4f16-b122-fd4def97526c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:30.923426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84c2df-4a84-40a0-8f95-fe48bf6c87f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:30.924046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84c2df-4a84-40a0-8f95-fe48bf6c87f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:30.924325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84c2df-4a84-40a0-8f95-fe48bf6c87f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:30.924597 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84c2df-4a84-40a0-8f95-fe48bf6c87f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:30.936225 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84c2df-4a84-40a0-8f95-fe48bf6c87f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:30.937862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84c2df-4a84-40a0-8f95-fe48bf6c87f6 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:30.948689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1329/2640] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:31.218739 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f92ba6-397b-4735-bf9d-f9c7850f34f5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:31.220198 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a9f92ba6-397b-4735-bf9d-f9c7850f34f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:31.231955 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f92ba6-397b-4735-bf9d-f9c7850f34f5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:31.236731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:31.237407 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.237685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.237953 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] PATH_INFO: `/v3/projects/71a1859322764c19b09116102b8d318c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.239056 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a1859322764c19b09116102b8d318c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:31.240945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:31.288522 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:31.292773 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a1859322764c19b09116102b8d318c', 'request_id': 'req-c6485517-5679-472e-8c32-c05329e76983'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:31.302025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a1859322764c19b09116102b8d318c', 'request_id': 'req-c6485517-5679-472e-8c32-c05329e76983'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:31.307764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a1859322764c19b09116102b8d318c', 'request_id': 'req-c6485517-5679-472e-8c32-c05329e76983'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:31.320657 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] The token cache is being invalidate because project 71a1859322764c19b09116102b8d318c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:31.320938 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:31.321581 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-c6485517-5679-472e-8c32-c05329e76983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:31.323047 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1312/2641] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:31 2022] DELETE /identity/v3/projects/71a1859322764c19b09116102b8d318c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:31.328229 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448142da-b79b-423f-a47c-e888e0c69a8e None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.328507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448142da-b79b-423f-a47c-e888e0c69a8e None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.328776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448142da-b79b-423f-a47c-e888e0c69a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.348263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-448142da-b79b-423f-a47c-e888e0c69a8e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:31.349432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-448142da-b79b-423f-a47c-e888e0c69a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:31.412972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1330/2642] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:31.421000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7b00-c7d2-438d-a701-b35ba950065f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.421318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7b00-c7d2-438d-a701-b35ba950065f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.421588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c7b00-c7d2-438d-a701-b35ba950065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.442885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8a8c7b00-c7d2-438d-a701-b35ba950065f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:31.444124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8a8c7b00-c7d2-438d-a701-b35ba950065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:31.452890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1313/2643] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:31.457333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448142da-b79b-423f-a47c-e888e0c69a8e None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:31.467482 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448142da-b79b-423f-a47c-e888e0c69a8e None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:31.471979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:31.472576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.472853 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.473109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.473785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:25:31.474105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:31.475665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:31.487494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1331/2644] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:25:31.491916 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c7b00-c7d2-438d-a701-b35ba950065f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:31.502029 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c7b00-c7d2-438d-a701-b35ba950065f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:31.507930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366f84-3774-438a-84cc-7bd7b7cce7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:31.508535 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366f84-3774-438a-84cc-7bd7b7cce7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.508844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366f84-3774-438a-84cc-7bd7b7cce7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.509107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366f84-3774-438a-84cc-7bd7b7cce7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.509780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366f84-3774-438a-84cc-7bd7b7cce7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:31.511713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366f84-3774-438a-84cc-7bd7b7cce7e6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:31.542114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1314/2645] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:25:31 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:31.546496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:31.557039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e7541-7ce2-43ae-ba16-4ebdd9c812d7 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:31.604303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:31.614256 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637f98-76bb-4abf-b2bc-52db0144c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:31.614870 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637f98-76bb-4abf-b2bc-52db0144c2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.615304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637f98-76bb-4abf-b2bc-52db0144c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.616009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637f98-76bb-4abf-b2bc-52db0144c2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.616865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61637f98-76bb-4abf-b2bc-52db0144c2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:31.618825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61637f98-76bb-4abf-b2bc-52db0144c2b9 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:31.642705 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1332/2646] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:25:31 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:31.646918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366f84-3774-438a-84cc-7bd7b7cce7e6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:31.658205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366f84-3774-438a-84cc-7bd7b7cce7e6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:31.663740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42d18b-ce6d-4d6b-aeb1-165b70610bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:31.664336 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42d18b-ce6d-4d6b-aeb1-165b70610bad admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.664604 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42d18b-ce6d-4d6b-aeb1-165b70610bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.664867 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42d18b-ce6d-4d6b-aeb1-165b70610bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.665549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42d18b-ce6d-4d6b-aeb1-165b70610bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:31.667139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42d18b-ce6d-4d6b-aeb1-165b70610bad admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:31.678050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1315/2647] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:31.682186 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637f98-76bb-4abf-b2bc-52db0144c2b9 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:31.692676 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637f98-76bb-4abf-b2bc-52db0144c2b9 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:31.699079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cbd7d-f043-4723-83ba-4144e5a388eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:31.699699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbd7d-f043-4723-83ba-4144e5a388eb admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.699984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbd7d-f043-4723-83ba-4144e5a388eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.700257 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbd7d-f043-4723-83ba-4144e5a388eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.701047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cbd7d-f043-4723-83ba-4144e5a388eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:31.702699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cbd7d-f043-4723-83ba-4144e5a388eb admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:31.714028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1333/2648] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:31.718939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42d18b-ce6d-4d6b-aeb1-165b70610bad admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:31.734918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42d18b-ce6d-4d6b-aeb1-165b70610bad admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:31.740264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:31.740929 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.741245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.741516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] PATH_INFO: `/v3/projects/082b3febd43a4ce394bb5adb9f7bc06f/users/f1ed2572803240a69ca9b63dde720cf2/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.757488 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=082b3febd43a4ce394bb5adb9f7bc06f, user_id=f1ed2572803240a69ca9b63dde720cf2, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:31.760107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:31.774872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1316/2649] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:31 2022] PUT /identity/v3/projects/082b3febd43a4ce394bb5adb9f7bc06f/users/f1ed2572803240a69ca9b63dde720cf2/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:25:31.788609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24427dd3-fda0-472d-994c-b71679af6c0f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.788910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24427dd3-fda0-472d-994c-b71679af6c0f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.789194 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24427dd3-fda0-472d-994c-b71679af6c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:31.825410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-24427dd3-fda0-472d-994c-b71679af6c0f None None] MFA Rules not processed for user `f1ed2572803240a69ca9b63dde720cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:31.827015 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-24427dd3-fda0-472d-994c-b71679af6c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:31.902044 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1334/2650] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:31.913359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:31.915094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:31.992292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677417ac-9d4d-494a-ad60-7072ac36caa1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:31.995967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1280a9-7a0b-4b09-8c4b-60eb9b7b189c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:31.996633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1280a9-7a0b-4b09-8c4b-60eb9b7b189c service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:31.996852 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1280a9-7a0b-4b09-8c4b-60eb9b7b189c service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:31.997149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1280a9-7a0b-4b09-8c4b-60eb9b7b189c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:32.008838 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1280a9-7a0b-4b09-8c4b-60eb9b7b189c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:32.010749 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1280a9-7a0b-4b09-8c4b-60eb9b7b189c service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:32.022872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1317/2651] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:41.899421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:42.018480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:42.174033 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24427dd3-fda0-472d-994c-b71679af6c0f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:42.240466 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24427dd3-fda0-472d-994c-b71679af6c0f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:42.245552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:42.246175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:42.246452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:42.246722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] PATH_INFO: `/v3/users/f1ed2572803240a69ca9b63dde720cf2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:42.247896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ed2572803240a69ca9b63dde720cf2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:42.250146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:42.309293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ed2572803240a69ca9b63dde720cf2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.309293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ed2572803240a69ca9b63dde720cf2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.318486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ed2572803240a69ca9b63dde720cf2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.325574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ed2572803240a69ca9b63dde720cf2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.336770 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ed2572803240a69ca9b63dde720cf2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.344719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1335/2652] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:42 2022] DELETE /identity/v3/users/f1ed2572803240a69ca9b63dde720cf2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:42.349180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadceadf-7e96-4c54-b9cb-0ad742ff0a83 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:42.349465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadceadf-7e96-4c54-b9cb-0ad742ff0a83 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:42.349734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadceadf-7e96-4c54-b9cb-0ad742ff0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:42.369633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-eadceadf-7e96-4c54-b9cb-0ad742ff0a83 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:42.370992 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-eadceadf-7e96-4c54-b9cb-0ad742ff0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:42.435577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1318/2653] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:42.445729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:42.447279 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:42.508177 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767c68-6b3d-4d2d-9665-66f3c37b4dbb admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:42.511941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:42.512559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:42.512832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:42.513128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:42.522966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:42.524467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:42.536017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1336/2654] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:42.827621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadceadf-7e96-4c54-b9cb-0ad742ff0a83 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:42.829416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-eadceadf-7e96-4c54-b9cb-0ad742ff0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:42.843747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadceadf-7e96-4c54-b9cb-0ad742ff0a83 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:42.849908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:42.850656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:42.850934 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:42.851193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] PATH_INFO: `/v3/projects/082b3febd43a4ce394bb5adb9f7bc06f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:42.852408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=082b3febd43a4ce394bb5adb9f7bc06f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:42.854413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:42.909004 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082b3febd43a4ce394bb5adb9f7bc06f', 'request_id': 'req-135b2082-fa1d-49ea-b819-4112885f2ffd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.921226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082b3febd43a4ce394bb5adb9f7bc06f', 'request_id': 'req-135b2082-fa1d-49ea-b819-4112885f2ffd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.927265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082b3febd43a4ce394bb5adb9f7bc06f', 'request_id': 'req-135b2082-fa1d-49ea-b819-4112885f2ffd'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.939314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] The token cache is being invalidate because project 082b3febd43a4ce394bb5adb9f7bc06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:42.939602 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.940289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:42.941785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1319/2655] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:42 2022] DELETE /identity/v3/projects/082b3febd43a4ce394bb5adb9f7bc06f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:47.251167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:47.252786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:47.288567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:47.345358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5f96-f401-4256-8f23-26a921667393 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:47.424366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408bc72-7ff4-4f95-ba4b-7ee153628bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:47.425034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408bc72-7ff4-4f95-ba4b-7ee153628bf1 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:47.425335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408bc72-7ff4-4f95-ba4b-7ee153628bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:47.425608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408bc72-7ff4-4f95-ba4b-7ee153628bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:47.430887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6408bc72-7ff4-4f95-ba4b-7ee153628bf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:47.443917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408bc72-7ff4-4f95-ba4b-7ee153628bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:47.445649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408bc72-7ff4-4f95-ba4b-7ee153628bf1 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:47.456735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1337/2656] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:52.160759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:52.162465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:52.235566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b2082-fa1d-49ea-b819-4112885f2ffd admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:52.240764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:52.241449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:52.241722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:52.241989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] PATH_INFO: `/v3/users/7087b0f5a5064604ae8d13cfc4b7f03e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:52.243145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7087b0f5a5064604ae8d13cfc4b7f03e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:52.245483 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:52.281215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:52.317517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7087b0f5a5064604ae8d13cfc4b7f03e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:52.331076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7087b0f5a5064604ae8d13cfc4b7f03e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:52.339071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7087b0f5a5064604ae8d13cfc4b7f03e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:52.350374 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7087b0f5a5064604ae8d13cfc4b7f03e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:52.351069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7087b0f5a5064604ae8d13cfc4b7f03e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:52.359230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1320/2657] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:52 2022] DELETE /identity/v3/users/7087b0f5a5064604ae8d13cfc4b7f03e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:52.364212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223cca0-c214-48ab-ae09-f11346c18763 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:52.364924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223cca0-c214-48ab-ae09-f11346c18763 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:52.364924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223cca0-c214-48ab-ae09-f11346c18763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:52.386995 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-6223cca0-c214-48ab-ae09-f11346c18763 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:52.388241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6223cca0-c214-48ab-ae09-f11346c18763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:52.454006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1338/2658] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:25:52.464226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:52.465748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:52.525705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f564f4-bdd0-4349-af4c-99357979e5e3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:52.529588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7155-ae99-4fbb-b61c-8b3c81e0a01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:52.530570 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7155-ae99-4fbb-b61c-8b3c81e0a01b service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:52.530851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7155-ae99-4fbb-b61c-8b3c81e0a01b service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:52.531123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7155-ae99-4fbb-b61c-8b3c81e0a01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:52.540743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7155-ae99-4fbb-b61c-8b3c81e0a01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:52.542251 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7155-ae99-4fbb-b61c-8b3c81e0a01b service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:52.552324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1321/2659] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:53.006050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223cca0-c214-48ab-ae09-f11346c18763 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:53.008515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-6223cca0-c214-48ab-ae09-f11346c18763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:53.027916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223cca0-c214-48ab-ae09-f11346c18763 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:53.034105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:53.035162 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:53.035542 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:53.035897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] PATH_INFO: `/v3/projects/72d232f664ef45b3a9a754b37430b602` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:53.037547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d232f664ef45b3a9a754b37430b602)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:53.040402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:53.103942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:53.114616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d232f664ef45b3a9a754b37430b602', 'request_id': 'req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.123937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d232f664ef45b3a9a754b37430b602', 'request_id': 'req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.132011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d232f664ef45b3a9a754b37430b602', 'request_id': 'req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.152699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] The token cache is being invalidate because project 72d232f664ef45b3a9a754b37430b602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:53.153213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.154505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.157693 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1339/2660] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:53 2022] DELETE /identity/v3/projects/72d232f664ef45b3a9a754b37430b602 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:53.161820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7155-ae99-4fbb-b61c-8b3c81e0a01b service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:53.174329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7155-ae99-4fbb-b61c-8b3c81e0a01b service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:53.264615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:53.265292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:53.265850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:53.266124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] PATH_INFO: `/v3/users/c02cf56c98414b32b204bfc08540626c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:53.267514 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02cf56c98414b32b204bfc08540626c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:53.270662 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:53.340256 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02cf56c98414b32b204bfc08540626c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.350915 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:53.367647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02cf56c98414b32b204bfc08540626c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.375504 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02cf56c98414b32b204bfc08540626c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.385545 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02cf56c98414b32b204bfc08540626c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.386225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-8d5a2a86-390e-4eba-ad62-08fcc8534a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02cf56c98414b32b204bfc08540626c'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:53.393029 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1322/2661] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:53 2022] DELETE /identity/v3/users/c02cf56c98414b32b204bfc08540626c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:53.884004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:53.885547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:53.899498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023493e8-5b4b-4ed4-be0f-1d906e58e4c8 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:53.962811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:53.963366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:53.963643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:53.963913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] PATH_INFO: `/v3/projects/2e3c469a1c644c14b8aad6eb6ff21b7b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:53.965027 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3c469a1c644c14b8aad6eb6ff21b7b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:53.966966 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:54.015432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3c469a1c644c14b8aad6eb6ff21b7b', 'request_id': 'req-8f576031-f16a-4707-84ec-df4dfaec932c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:54.022065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3c469a1c644c14b8aad6eb6ff21b7b', 'request_id': 'req-8f576031-f16a-4707-84ec-df4dfaec932c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:54.032666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3c469a1c644c14b8aad6eb6ff21b7b', 'request_id': 'req-8f576031-f16a-4707-84ec-df4dfaec932c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:54.048776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] The token cache is being invalidate because project 2e3c469a1c644c14b8aad6eb6ff21b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:54.049181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:54.049993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8f576031-f16a-4707-84ec-df4dfaec932c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:54.051588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1340/2662] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:53 2022] DELETE /identity/v3/projects/2e3c469a1c644c14b8aad6eb6ff21b7b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:54.056510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d918-30a7-4dd1-8244-8491e7aea62d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.056800 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d918-30a7-4dd1-8244-8491e7aea62d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.057068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d918-30a7-4dd1-8244-8491e7aea62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.083479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e1e0d918-30a7-4dd1-8244-8491e7aea62d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:54.084316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e1e0d918-30a7-4dd1-8244-8491e7aea62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:54.185141 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1323/2663] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:54.195122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2027c4-696a-461a-8ee2-fe5c4949c9dd None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.195422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2027c4-696a-461a-8ee2-fe5c4949c9dd None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.195698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2027c4-696a-461a-8ee2-fe5c4949c9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.220768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fc2027c4-696a-461a-8ee2-fe5c4949c9dd None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:54.224629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fc2027c4-696a-461a-8ee2-fe5c4949c9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:54.235889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1341/2664] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:54.241494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0d918-30a7-4dd1-8244-8491e7aea62d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:54.262455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0d918-30a7-4dd1-8244-8491e7aea62d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:54.267330 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:54.268096 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.268370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.268671 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.269381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:25:54.269685 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:54.271351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:54.299966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1324/2665] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:25:54.304942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2027c4-696a-461a-8ee2-fe5c4949c9dd None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:54.315897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2027c4-696a-461a-8ee2-fe5c4949c9dd None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:54.322909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4b8ab-af8e-4398-971c-69c5f4a7c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:54.323577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4b8ab-af8e-4398-971c-69c5f4a7c03a admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.323856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4b8ab-af8e-4398-971c-69c5f4a7c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.324123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4b8ab-af8e-4398-971c-69c5f4a7c03a admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.324758 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4b8ab-af8e-4398-971c-69c5f4a7c03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:54.326702 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4b8ab-af8e-4398-971c-69c5f4a7c03a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:54.367567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1342/2666] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:25:54 2022] POST /identity/v3/projects => generated 355 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:54.371650 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:54.384025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df55ad-fd69-4246-abc4-ce282ac18631 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:54.462007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf802cb6-10b0-4208-b52c-2f24f20d34f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:54.462772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf802cb6-10b0-4208-b52c-2f24f20d34f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.463122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf802cb6-10b0-4208-b52c-2f24f20d34f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.463462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf802cb6-10b0-4208-b52c-2f24f20d34f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.465791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf802cb6-10b0-4208-b52c-2f24f20d34f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:54.469561 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf802cb6-10b0-4208-b52c-2f24f20d34f2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:54.499009 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1325/2667] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:25:54 2022] POST /identity/v3/users => generated 278 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:25:54.503489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4b8ab-af8e-4398-971c-69c5f4a7c03a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:54.520012 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4b8ab-af8e-4398-971c-69c5f4a7c03a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:54.531217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef995-0a24-4a67-96c8-bbe12f1c8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:54.532174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef995-0a24-4a67-96c8-bbe12f1c8735 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.532610 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef995-0a24-4a67-96c8-bbe12f1c8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.533050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ef995-0a24-4a67-96c8-bbe12f1c8735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.533936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef995-0a24-4a67-96c8-bbe12f1c8735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:54.535789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ef995-0a24-4a67-96c8-bbe12f1c8735 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:54.567657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1343/2668] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:54.568713 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf802cb6-10b0-4208-b52c-2f24f20d34f2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:54.581553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf802cb6-10b0-4208-b52c-2f24f20d34f2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:54.591666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d0d64-40bd-4f3b-bf18-cf340b398f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:54.592366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d0d64-40bd-4f3b-bf18-cf340b398f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.592643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d0d64-40bd-4f3b-bf18-cf340b398f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.592912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d0d64-40bd-4f3b-bf18-cf340b398f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.593675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d0d64-40bd-4f3b-bf18-cf340b398f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:54.595232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d0d64-40bd-4f3b-bf18-cf340b398f20 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:54.612076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1326/2669] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:54.614153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef995-0a24-4a67-96c8-bbe12f1c8735 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:54.634969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ef995-0a24-4a67-96c8-bbe12f1c8735 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:54.643860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9b70-8095-4b4b-841c-2ca727ce1a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:54.646287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9b70-8095-4b4b-841c-2ca727ce1a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.646586 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9b70-8095-4b4b-841c-2ca727ce1a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.646859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db9b70-8095-4b4b-841c-2ca727ce1a73 admin admin] PATH_INFO: `/v3/projects/2d1ac476b77c47b6bcebdd7a5bbc474e/users/3aa70782b3df4059a766516aa9a779d8/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.666887 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db9b70-8095-4b4b-841c-2ca727ce1a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1ac476b77c47b6bcebdd7a5bbc474e, user_id=3aa70782b3df4059a766516aa9a779d8, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:54.669766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db9b70-8095-4b4b-841c-2ca727ce1a73 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:54.673580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:54.694042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1344/2670] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:54 2022] PUT /identity/v3/projects/2d1ac476b77c47b6bcebdd7a5bbc474e/users/3aa70782b3df4059a766516aa9a779d8/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:25:54.706822 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69cff3-e39f-46c9-93ff-850c8bfd9eee None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.707124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69cff3-e39f-46c9-93ff-850c8bfd9eee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.707396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69cff3-e39f-46c9-93ff-850c8bfd9eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.747142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fc69cff3-e39f-46c9-93ff-850c8bfd9eee None None] MFA Rules not processed for user `3aa70782b3df4059a766516aa9a779d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:54.748265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fc69cff3-e39f-46c9-93ff-850c8bfd9eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:54.773497 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:54.829127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1327/2671] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:54.833508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9b70-8095-4b4b-841c-2ca727ce1a73 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:54.904869 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db9b70-8095-4b4b-841c-2ca727ce1a73 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:54.910486 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141742-cce7-460d-a029-d018aefb5618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:54.911102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141742-cce7-460d-a029-d018aefb5618 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:54.911383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141742-cce7-460d-a029-d018aefb5618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:54.911656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141742-cce7-460d-a029-d018aefb5618 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:54.912291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141742-cce7-460d-a029-d018aefb5618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:54.914216 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141742-cce7-460d-a029-d018aefb5618 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:54.946625 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1345/2672] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:25:54 2022] POST /identity/v3/projects => generated 355 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:25:54.947753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69cff3-e39f-46c9-93ff-850c8bfd9eee None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:54.959696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69cff3-e39f-46c9-93ff-850c8bfd9eee None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:55.017507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3e88-6f9d-45ab-aa64-0ad7a545a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:55.018038 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e88-6f9d-45ab-aa64-0ad7a545a5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:55.018413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e88-6f9d-45ab-aa64-0ad7a545a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:55.018715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e88-6f9d-45ab-aa64-0ad7a545a5c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:55.019386 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a3e88-6f9d-45ab-aa64-0ad7a545a5c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:55.021353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a3e88-6f9d-45ab-aa64-0ad7a545a5c8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:55.049309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1328/2673] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:25:54 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:25:55.050850 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141742-cce7-460d-a029-d018aefb5618 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:55.061960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141742-cce7-460d-a029-d018aefb5618 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:55.068479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d95f2-31b4-4c1c-ac20-316c6f56f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:55.069108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d95f2-31b4-4c1c-ac20-316c6f56f0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:55.069373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d95f2-31b4-4c1c-ac20-316c6f56f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:55.069663 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d95f2-31b4-4c1c-ac20-316c6f56f0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:55.070310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d95f2-31b4-4c1c-ac20-316c6f56f0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:55.071911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d95f2-31b4-4c1c-ac20-316c6f56f0b2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:55.083826 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1346/2674] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:25:55.088566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3e88-6f9d-45ab-aa64-0ad7a545a5c8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:55.099531 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3e88-6f9d-45ab-aa64-0ad7a545a5c8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:55.105613 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebfbab-3576-4f61-bb76-e15ee69b70ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:55.106289 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebfbab-3576-4f61-bb76-e15ee69b70ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:55.106572 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebfbab-3576-4f61-bb76-e15ee69b70ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:55.106846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebfbab-3576-4f61-bb76-e15ee69b70ad admin admin] PATH_INFO: `/v3/projects/19b1e367992840eba067305e9db0286f/users/f377286ac950423486e02dfb1daa8170/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:55.123048 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebfbab-3576-4f61-bb76-e15ee69b70ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b1e367992840eba067305e9db0286f, user_id=f377286ac950423486e02dfb1daa8170, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:55.125766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebfbab-3576-4f61-bb76-e15ee69b70ad admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:55.141480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1329/2675] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:55 2022] PUT /identity/v3/projects/19b1e367992840eba067305e9db0286f/users/f377286ac950423486e02dfb1daa8170/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:55.145979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d95f2-31b4-4c1c-ac20-316c6f56f0b2 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:55.159945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d95f2-31b4-4c1c-ac20-316c6f56f0b2 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:55.219338 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783d2c-8d02-4bc5-9937-36fc2c18e35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:55.219965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783d2c-8d02-4bc5-9937-36fc2c18e35c admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:55.220249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783d2c-8d02-4bc5-9937-36fc2c18e35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:55.220523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783d2c-8d02-4bc5-9937-36fc2c18e35c admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:55.221209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783d2c-8d02-4bc5-9937-36fc2c18e35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:55.222979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783d2c-8d02-4bc5-9937-36fc2c18e35c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:55.236340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1347/2676] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:25:55.237734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebfbab-3576-4f61-bb76-e15ee69b70ad admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:55.248594 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebfbab-3576-4f61-bb76-e15ee69b70ad admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:55.254065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:55.254731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:55.255006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:55.255273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] PATH_INFO: `/v3/projects/19b1e367992840eba067305e9db0286f/users/f377286ac950423486e02dfb1daa8170/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:55.257420 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b1e367992840eba067305e9db0286f, user_id=f377286ac950423486e02dfb1daa8170, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:55.260053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:55.271526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1330/2677] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:25:55 2022] PUT /identity/v3/projects/19b1e367992840eba067305e9db0286f/users/f377286ac950423486e02dfb1daa8170/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:25:55.283584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb99d6-7e9d-4943-b5f1-961a6eb90d91 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:55.284159 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb99d6-7e9d-4943-b5f1-961a6eb90d91 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:55.284503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb99d6-7e9d-4943-b5f1-961a6eb90d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:55.314240 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-79bb99d6-7e9d-4943-b5f1-961a6eb90d91 None None] MFA Rules not processed for user `f377286ac950423486e02dfb1daa8170`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:25:55.315447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-79bb99d6-7e9d-4943-b5f1-961a6eb90d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:55.368470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:55.387340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1348/2678] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:25:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:25:55.399089 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:55.401060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:55.474627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5651f8-0a11-47d9-8f1a-41dcaeca58d7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:55.478797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:55.479412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:55.479691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:55.479963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:55.489996 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:55.491444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:55.501917 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1331/2679] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:55.584505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb99d6-7e9d-4943-b5f1-961a6eb90d91 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:55.594470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb99d6-7e9d-4943-b5f1-961a6eb90d91 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:55.598566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bde69-b78a-475c-8185-4224493ffa3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:55.599174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bde69-b78a-475c-8185-4224493ffa3d service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:55.599449 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bde69-b78a-475c-8185-4224493ffa3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:55.599714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bde69-b78a-475c-8185-4224493ffa3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:55.658537 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bde69-b78a-475c-8185-4224493ffa3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:55.660105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bde69-b78a-475c-8185-4224493ffa3d service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:55.670271 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1349/2680] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:25:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:25:58.119277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:58.122294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:58.144642 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:58.213490 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985ab90-07e9-4d53-9ad5-3fc4a58be3b3 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:58.218414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:58.219164 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:58.219553 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:58.219846 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] PATH_INFO: `/v3/users/bb83a2d6d86f4cc18e5ee315d4ea5841` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:58.221037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb83a2d6d86f4cc18e5ee315d4ea5841)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:58.223037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:58.279913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb83a2d6d86f4cc18e5ee315d4ea5841'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.295273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb83a2d6d86f4cc18e5ee315d4ea5841'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.305549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb83a2d6d86f4cc18e5ee315d4ea5841'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.314476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb83a2d6d86f4cc18e5ee315d4ea5841'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.315328 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb83a2d6d86f4cc18e5ee315d4ea5841'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.325646 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1332/2681] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:58 2022] DELETE /identity/v3/users/bb83a2d6d86f4cc18e5ee315d4ea5841 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:58.539114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bde69-b78a-475c-8185-4224493ffa3d service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:58.551933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bde69-b78a-475c-8185-4224493ffa3d service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:58.616924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:58.617242 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:58.617519 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:58.617862 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] PATH_INFO: `/v3/projects/5b318cb900ce4b749a0381c668a5bdee` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:58.618949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b318cb900ce4b749a0381c668a5bdee)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:58.620888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:58.678067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b318cb900ce4b749a0381c668a5bdee', 'request_id': 'req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.684087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b318cb900ce4b749a0381c668a5bdee', 'request_id': 'req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.690841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b318cb900ce4b749a0381c668a5bdee', 'request_id': 'req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.705298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] The token cache is being invalidate because project 5b318cb900ce4b749a0381c668a5bdee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:58.705589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.706254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.707776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1350/2682] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:58 2022] DELETE /identity/v3/projects/5b318cb900ce4b749a0381c668a5bdee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:58.711705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:58.713099 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:58.726226 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1de117-7a41-4abc-a344-ab66b32d1450 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:58.787276 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:58.787913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:58.788188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:58.788464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] PATH_INFO: `/v3/users/ba59a17c6516481cb72f8ad57a793e1e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:58.789667 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba59a17c6516481cb72f8ad57a793e1e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:58.791582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:58.833956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:58.846435 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba59a17c6516481cb72f8ad57a793e1e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.860849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba59a17c6516481cb72f8ad57a793e1e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.868070 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba59a17c6516481cb72f8ad57a793e1e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.876243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba59a17c6516481cb72f8ad57a793e1e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.876890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0348c63d-7066-45c6-b83f-fb7eba8e7b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba59a17c6516481cb72f8ad57a793e1e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:58.883024 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1333/2683] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:25:58 2022] DELETE /identity/v3/users/ba59a17c6516481cb72f8ad57a793e1e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:25:59.059005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:25:59.060541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:25:59.075357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7c2e2-18a9-4144-ae5d-f2e5cb1d56df admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:25:59.093601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:25:59.135699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:25:59.136328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:25:59.136600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:25:59.136882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] PATH_INFO: `/v3/projects/0ee08c1ddfd54c1d88bf762d4fad61ca` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:25:59.138072 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee08c1ddfd54c1d88bf762d4fad61ca)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:25:59.139972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:25:59.187440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee08c1ddfd54c1d88bf762d4fad61ca', 'request_id': 'req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:59.193127 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee08c1ddfd54c1d88bf762d4fad61ca', 'request_id': 'req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:59.199198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee08c1ddfd54c1d88bf762d4fad61ca', 'request_id': 'req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:59.212983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] The token cache is being invalidate because project 0ee08c1ddfd54c1d88bf762d4fad61ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:25:59.213297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:59.213910 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:25:59.215425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1351/2684] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:25:59 2022] DELETE /identity/v3/projects/0ee08c1ddfd54c1d88bf762d4fad61ca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:04.121335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c2ef-d0e5-4ef5-bc88-9e1a847dea78 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:04.121879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c2ef-d0e5-4ef5-bc88-9e1a847dea78 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:04.121879 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043c2ef-d0e5-4ef5-bc88-9e1a847dea78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:04.143564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c043c2ef-d0e5-4ef5-bc88-9e1a847dea78 None None] MFA Rules not processed for user `fd4b6cdf2af34a3da05bbc4b0e8f699d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:04.144882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c043c2ef-d0e5-4ef5-bc88-9e1a847dea78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:04.216774 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1334/2685] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:04.544246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:04.545924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:04.615022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e680a2-02dc-4664-9ff4-d2ba0ba41d34 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:04.618937 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe9497-67cd-41ef-a465-8965e12d00bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:04.619553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9497-67cd-41ef-a465-8965e12d00bf service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:04.619827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9497-67cd-41ef-a465-8965e12d00bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:04.620093 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9497-67cd-41ef-a465-8965e12d00bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:04.621890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3ffe9497-67cd-41ef-a465-8965e12d00bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:04.632766 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe9497-67cd-41ef-a465-8965e12d00bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:04.634231 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe9497-67cd-41ef-a465-8965e12d00bf service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:04.643450 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1352/2686] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:26:10.898302 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c2ef-d0e5-4ef5-bc88-9e1a847dea78 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:10.899899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c043c2ef-d0e5-4ef5-bc88-9e1a847dea78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:10.963294 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043c2ef-d0e5-4ef5-bc88-9e1a847dea78 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:10.968332 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:10.968974 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:10.969282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:10.969577 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] PATH_INFO: `/v3/users/3aa70782b3df4059a766516aa9a779d8` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:10.970747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa70782b3df4059a766516aa9a779d8)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:10.972888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:11.028872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa70782b3df4059a766516aa9a779d8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.039745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:11.042362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa70782b3df4059a766516aa9a779d8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.052510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa70782b3df4059a766516aa9a779d8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.060366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa70782b3df4059a766516aa9a779d8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.060984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa70782b3df4059a766516aa9a779d8'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.067526 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1335/2687] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:26:10 2022] DELETE /identity/v3/users/3aa70782b3df4059a766516aa9a779d8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:11.072287 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f4cdc-b34c-48f2-ad90-f7180913e1d9 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:11.072781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f4cdc-b34c-48f2-ad90-f7180913e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:11.072900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f4cdc-b34c-48f2-ad90-f7180913e1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:11.092301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-195f4cdc-b34c-48f2-ad90-f7180913e1d9 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:11.093552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-195f4cdc-b34c-48f2-ad90-f7180913e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:11.150506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:11.166185 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1353/2688] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:11.176440 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:11.178023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:11.238187 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28a0d-6aec-49bf-af89-5c6bd210006b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:11.242544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ba1c-7833-4e61-bcb8-6505c1a9da9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:11.243149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ba1c-7833-4e61-bcb8-6505c1a9da9a service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:11.243427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ba1c-7833-4e61-bcb8-6505c1a9da9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:11.243698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ba1c-7833-4e61-bcb8-6505c1a9da9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:11.253372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ba1c-7833-4e61-bcb8-6505c1a9da9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:11.254994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ba1c-7833-4e61-bcb8-6505c1a9da9a service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:11.264674 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1336/2689] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:26:11.551246 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f4cdc-b34c-48f2-ad90-f7180913e1d9 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:11.552932 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-195f4cdc-b34c-48f2-ad90-f7180913e1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:11.565627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f4cdc-b34c-48f2-ad90-f7180913e1d9 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:11.570954 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:11.571606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:11.571884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:11.572153 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] PATH_INFO: `/v3/projects/2d1ac476b77c47b6bcebdd7a5bbc474e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:11.573421 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1ac476b77c47b6bcebdd7a5bbc474e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:11.575356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:11.629968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1ac476b77c47b6bcebdd7a5bbc474e', 'request_id': 'req-06e1f475-2cec-4207-b9e3-85a07d522012'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.638540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1ac476b77c47b6bcebdd7a5bbc474e', 'request_id': 'req-06e1f475-2cec-4207-b9e3-85a07d522012'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.645991 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1ac476b77c47b6bcebdd7a5bbc474e', 'request_id': 'req-06e1f475-2cec-4207-b9e3-85a07d522012'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.663089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] The token cache is being invalidate because project 2d1ac476b77c47b6bcebdd7a5bbc474e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:26:11.663397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.664006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.665630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1354/2690] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:26:11 2022] DELETE /identity/v3/projects/2d1ac476b77c47b6bcebdd7a5bbc474e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:11.669690 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ba1c-7833-4e61-bcb8-6505c1a9da9a service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:11.679750 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ba1c-7833-4e61-bcb8-6505c1a9da9a service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:11.736598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:11.737380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:11.737663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:11.737933 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] PATH_INFO: `/v3/users/f377286ac950423486e02dfb1daa8170` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:11.739362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f377286ac950423486e02dfb1daa8170)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:11.741310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:11.795382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f377286ac950423486e02dfb1daa8170'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.808906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f377286ac950423486e02dfb1daa8170'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.815924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f377286ac950423486e02dfb1daa8170'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.826263 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f377286ac950423486e02dfb1daa8170'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.826965 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3255c56d-b2ac-44b9-b906-fe491f823dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f377286ac950423486e02dfb1daa8170'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:11.829219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:11.833990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1337/2691] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:26:11 2022] DELETE /identity/v3/users/f377286ac950423486e02dfb1daa8170 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:12.128465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.130132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:12.143680 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1f475-2cec-4207-b9e3-85a07d522012 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.206132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.206671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.207183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.207459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] PATH_INFO: `/v3/projects/19b1e367992840eba067305e9db0286f` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.208669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b1e367992840eba067305e9db0286f)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.210617 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.267023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b1e367992840eba067305e9db0286f', 'request_id': 'req-b55c08d0-1eaa-44e6-a933-eea773c53ff4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:12.273328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b1e367992840eba067305e9db0286f', 'request_id': 'req-b55c08d0-1eaa-44e6-a933-eea773c53ff4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:12.279576 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b1e367992840eba067305e9db0286f', 'request_id': 'req-b55c08d0-1eaa-44e6-a933-eea773c53ff4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:12.292436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] The token cache is being invalidate because project 19b1e367992840eba067305e9db0286f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:26:12.292720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:12.293355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b55c08d0-1eaa-44e6-a933-eea773c53ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:12.294834 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1355/2692] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:26:12 2022] DELETE /identity/v3/projects/19b1e367992840eba067305e9db0286f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:12.299808 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c8d4-fd79-4bc2-b3ca-fa4ceabbe694 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.300285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c8d4-fd79-4bc2-b3ca-fa4ceabbe694 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.300405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c8d4-fd79-4bc2-b3ca-fa4ceabbe694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.320456 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d5c9c8d4-fd79-4bc2-b3ca-fa4ceabbe694 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:12.321723 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d5c9c8d4-fd79-4bc2-b3ca-fa4ceabbe694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:12.382743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1338/2693] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:12.390845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5cf9-59ea-4486-8e2e-c0cddf4245ca None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.391189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5cf9-59ea-4486-8e2e-c0cddf4245ca None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.391521 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca5cf9-59ea-4486-8e2e-c0cddf4245ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.407608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:12.413499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-4eca5cf9-59ea-4486-8e2e-c0cddf4245ca None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:12.414806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4eca5cf9-59ea-4486-8e2e-c0cddf4245ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:12.424002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1356/2694] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:26:12.428563 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9c8d4-fd79-4bc2-b3ca-fa4ceabbe694 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.438758 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9c8d4-fd79-4bc2-b3ca-fa4ceabbe694 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.444530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.445183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.445455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.445755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.446463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:26:12.446799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.448399 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.460981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1339/2695] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:26:12.465386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5cf9-59ea-4486-8e2e-c0cddf4245ca None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.474838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca5cf9-59ea-4486-8e2e-c0cddf4245ca None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.480074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.480670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.480953 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.481264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.481941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.483829 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.513352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1357/2696] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:26:12 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:12.518043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.529310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270bb219-b8c2-454e-b0c8-38831ec05065 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.536016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.537925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:12.593053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482d9d-1f46-47cc-ae65-6c4f9473e2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.593688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482d9d-1f46-47cc-ae65-6c4f9473e2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.593964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482d9d-1f46-47cc-ae65-6c4f9473e2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.594233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482d9d-1f46-47cc-ae65-6c4f9473e2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.594871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d482d9d-1f46-47cc-ae65-6c4f9473e2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.596770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d482d9d-1f46-47cc-ae65-6c4f9473e2e8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.623071 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d3b0-e24b-41d8-b655-4880797d9b83 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.628659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1340/2697] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:26:12 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:12.628659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482d9d-1f46-47cc-ae65-6c4f9473e2e8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.631052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.631757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.632383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.632500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.634206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:12.638849 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d482d9d-1f46-47cc-ae65-6c4f9473e2e8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.643716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7c80-7e6d-4911-9728-fd57d8f10355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.644478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7c80-7e6d-4911-9728-fd57d8f10355 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.644786 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7c80-7e6d-4911-9728-fd57d8f10355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.645014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7c80-7e6d-4911-9728-fd57d8f10355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.645727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7c80-7e6d-4911-9728-fd57d8f10355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.647260 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.647381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7c80-7e6d-4911-9728-fd57d8f10355 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.648830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.658436 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1341/2698] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:26:12.659793 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1358/2699] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:26:12.662327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7c80-7e6d-4911-9728-fd57d8f10355 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.672191 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7c80-7e6d-4911-9728-fd57d8f10355 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.678274 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6987da-275c-4549-9f31-6f76c232e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.679069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6987da-275c-4549-9f31-6f76c232e99a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.679419 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6987da-275c-4549-9f31-6f76c232e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.679886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6987da-275c-4549-9f31-6f76c232e99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.680634 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6987da-275c-4549-9f31-6f76c232e99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.682247 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6987da-275c-4549-9f31-6f76c232e99a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.696002 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1342/2700] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:12.697527 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.708422 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb23ab-447a-483f-b80f-7b41ce627ec5 service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.713768 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90020c7-67d0-4d48-8129-58e74673b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.714550 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90020c7-67d0-4d48-8129-58e74673b932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.714836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90020c7-67d0-4d48-8129-58e74673b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.715118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90020c7-67d0-4d48-8129-58e74673b932 admin admin] PATH_INFO: `/v3/projects/77c1b7cd94e34907884569dae0639fa3/users/756170e706cf49058d45834dec6aed3c/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.732408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90020c7-67d0-4d48-8129-58e74673b932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c1b7cd94e34907884569dae0639fa3, user_id=756170e706cf49058d45834dec6aed3c, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.735203 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90020c7-67d0-4d48-8129-58e74673b932 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.750356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1359/2701] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:12 2022] PUT /identity/v3/projects/77c1b7cd94e34907884569dae0639fa3/users/756170e706cf49058d45834dec6aed3c/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:12.761314 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a3b5-1806-460c-8b75-ed38a63c5c0d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.761593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a3b5-1806-460c-8b75-ed38a63c5c0d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.761891 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a3b5-1806-460c-8b75-ed38a63c5c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.791412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4814a3b5-1806-460c-8b75-ed38a63c5c0d None None] MFA Rules not processed for user `756170e706cf49058d45834dec6aed3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:12.792643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4814a3b5-1806-460c-8b75-ed38a63c5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:12.840207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:12.861741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1343/2702] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:12.866571 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90020c7-67d0-4d48-8129-58e74673b932 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.931294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90020c7-67d0-4d48-8129-58e74673b932 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:12.935919 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30bd4-5132-448d-bea9-82191f21c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:12.936525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30bd4-5132-448d-bea9-82191f21c656 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:12.936804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30bd4-5132-448d-bea9-82191f21c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:12.937074 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30bd4-5132-448d-bea9-82191f21c656 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:12.937746 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30bd4-5132-448d-bea9-82191f21c656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:12.939636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30bd4-5132-448d-bea9-82191f21c656 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:12.967371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1360/2703] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:26:12 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:12.971636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814a3b5-1806-460c-8b75-ed38a63c5c0d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:12.982892 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814a3b5-1806-460c-8b75-ed38a63c5c0d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:13.055444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb266d-e1ae-4e75-9d6d-6558b60688b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:13.056293 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb266d-e1ae-4e75-9d6d-6558b60688b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.056664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb266d-e1ae-4e75-9d6d-6558b60688b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.056967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb266d-e1ae-4e75-9d6d-6558b60688b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.057939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb266d-e1ae-4e75-9d6d-6558b60688b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:13.060806 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb266d-e1ae-4e75-9d6d-6558b60688b5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:13.086579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1344/2704] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:26:12 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:13.091286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30bd4-5132-448d-bea9-82191f21c656 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:13.104237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30bd4-5132-448d-bea9-82191f21c656 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:13.109196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86416-fee6-49c0-b899-c3d43e048300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:13.109711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86416-fee6-49c0-b899-c3d43e048300 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.110568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86416-fee6-49c0-b899-c3d43e048300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.110568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a86416-fee6-49c0-b899-c3d43e048300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.110968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a86416-fee6-49c0-b899-c3d43e048300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:13.112536 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a86416-fee6-49c0-b899-c3d43e048300 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:13.123877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1361/2705] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:13.128416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb266d-e1ae-4e75-9d6d-6558b60688b5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:13.139083 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb266d-e1ae-4e75-9d6d-6558b60688b5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:13.143835 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710851ca-7033-4828-8437-13218e5907e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:13.144494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710851ca-7033-4828-8437-13218e5907e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.144931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710851ca-7033-4828-8437-13218e5907e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.145460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710851ca-7033-4828-8437-13218e5907e6 admin admin] PATH_INFO: `/v3/projects/0e152c6ab086475d959ab1821646f1f1/users/6a8a004670a04f338eb216c78171e86c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.161507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710851ca-7033-4828-8437-13218e5907e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e152c6ab086475d959ab1821646f1f1, user_id=6a8a004670a04f338eb216c78171e86c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:13.164183 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710851ca-7033-4828-8437-13218e5907e6 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:13.180265 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1345/2706] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:13 2022] PUT /identity/v3/projects/0e152c6ab086475d959ab1821646f1f1/users/6a8a004670a04f338eb216c78171e86c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:13.184507 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86416-fee6-49c0-b899-c3d43e048300 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:13.195040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a86416-fee6-49c0-b899-c3d43e048300 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:13.204781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:13.253741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc42a77-ff61-4591-861b-3a7fed8d8e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:13.254553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc42a77-ff61-4591-861b-3a7fed8d8e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.254849 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc42a77-ff61-4591-861b-3a7fed8d8e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.255125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc42a77-ff61-4591-861b-3a7fed8d8e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.255774 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc42a77-ff61-4591-861b-3a7fed8d8e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:13.257387 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc42a77-ff61-4591-861b-3a7fed8d8e11 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:13.267690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1362/2707] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:13.273851 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710851ca-7033-4828-8437-13218e5907e6 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:13.284364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710851ca-7033-4828-8437-13218e5907e6 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:13.289062 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:13.289734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.290006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.290273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] PATH_INFO: `/v3/projects/0e152c6ab086475d959ab1821646f1f1/users/6a8a004670a04f338eb216c78171e86c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.292234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e152c6ab086475d959ab1821646f1f1, user_id=6a8a004670a04f338eb216c78171e86c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:13.294880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:13.304866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1346/2708] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:13 2022] PUT /identity/v3/projects/0e152c6ab086475d959ab1821646f1f1/users/6a8a004670a04f338eb216c78171e86c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:13.316146 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab18eb-226d-4cc6-aad8-32ab68556250 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.316462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab18eb-226d-4cc6-aad8-32ab68556250 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.316735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab18eb-226d-4cc6-aad8-32ab68556250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.345313 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-0eab18eb-226d-4cc6-aad8-32ab68556250 None None] MFA Rules not processed for user `6a8a004670a04f338eb216c78171e86c`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:13.346523 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-0eab18eb-226d-4cc6-aad8-32ab68556250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:13.425661 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1363/2709] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:13.438431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:13.440404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:13.500987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7775f-38e0-40d3-8fa9-2cb543bd4541 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:13.505430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767be41-4599-4088-85aa-90a8642530ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:13.505975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767be41-4599-4088-85aa-90a8642530ac service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.506252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767be41-4599-4088-85aa-90a8642530ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.506521 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767be41-4599-4088-85aa-90a8642530ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.517011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767be41-4599-4088-85aa-90a8642530ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:13.518507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767be41-4599-4088-85aa-90a8642530ac service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:13.528269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1347/2710] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:26:13.883107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab18eb-226d-4cc6-aad8-32ab68556250 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:13.893321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab18eb-226d-4cc6-aad8-32ab68556250 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:13.898533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8a004670a04f338eb216c78171e86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e152c6ab086475d959ab1821646f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:13.899133 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.899410 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.899683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.900333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:26:13.900635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:13.902272 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:13.914873 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1364/2711] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:26:13.918988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767be41-4599-4088-85aa-90a8642530ac service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:13.928559 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767be41-4599-4088-85aa-90a8642530ac service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:13.933686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed6957-b3bb-46f5-b0fd-7c4b95910c1a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8a004670a04f338eb216c78171e86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e152c6ab086475d959ab1821646f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:13.934329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6957-b3bb-46f5-b0fd-7c4b95910c1a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:13.934645 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6957-b3bb-46f5-b0fd-7c4b95910c1a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:13.934921 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6957-b3bb-46f5-b0fd-7c4b95910c1a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:13.935554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed6957-b3bb-46f5-b0fd-7c4b95910c1a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:13.937493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed6957-b3bb-46f5-b0fd-7c4b95910c1a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:13.971212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1348/2712] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:26:13 2022] POST /identity/v3/projects => generated 353 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:13.975844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:13.987199 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edcd3f-3b38-4e34-afe0-50b0724df0a4 tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:14.046428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8a004670a04f338eb216c78171e86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e152c6ab086475d959ab1821646f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:14.047032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:14.047314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:14.047590 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:14.048237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:26:14.048549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:14.050173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:14.062736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1365/2713] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:26:14.101579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed6957-b3bb-46f5-b0fd-7c4b95910c1a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:14.117203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed6957-b3bb-46f5-b0fd-7c4b95910c1a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:14.125123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a8a004670a04f338eb216c78171e86c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e152c6ab086475d959ab1821646f1f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:14.125961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:14.126290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:14.126607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] PATH_INFO: `/v3/projects/da8b3535304d46fc88590f6ff1f54c5d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:14.128446 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da8b3535304d46fc88590f6ff1f54c5d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:14.131381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:14.148467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:14.188820 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8b3535304d46fc88590f6ff1f54c5d', 'request_id': 'req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.198087 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8b3535304d46fc88590f6ff1f54c5d', 'request_id': 'req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.203730 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8b3535304d46fc88590f6ff1f54c5d', 'request_id': 'req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.215257 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] The token cache is being invalidate because project da8b3535304d46fc88590f6ff1f54c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:26:14.215557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.216188 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-56e2f9a3-953c-4be0-bc64-ef6130b15f2f tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.217727 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1349/2714] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:26:14 2022] DELETE /identity/v3/projects/da8b3535304d46fc88590f6ff1f54c5d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:14.435965 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:14.438083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:14.457498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=100 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:14.505973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f3c78-5c20-497e-a61b-8d7338e6483a tempest-VolumeQuotaClassesTest-965502888 tempest-VolumeQuotaClassesTest-965502888-project-admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:14.563238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:14.563890 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:14.564169 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:14.564443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] PATH_INFO: `/v3/users/756170e706cf49058d45834dec6aed3c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:14.565608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756170e706cf49058d45834dec6aed3c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:14.567719 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:14.615243 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756170e706cf49058d45834dec6aed3c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.615902 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756170e706cf49058d45834dec6aed3c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.637139 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756170e706cf49058d45834dec6aed3c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.645481 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756170e706cf49058d45834dec6aed3c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.654595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756170e706cf49058d45834dec6aed3c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:14.662488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1366/2715] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:26:14 2022] DELETE /identity/v3/users/756170e706cf49058d45834dec6aed3c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:14.667094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169cd10-8306-44b1-a295-9b532b1fe678 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:14.667614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169cd10-8306-44b1-a295-9b532b1fe678 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:14.667715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169cd10-8306-44b1-a295-9b532b1fe678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:14.687484 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f169cd10-8306-44b1-a295-9b532b1fe678 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:14.688688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f169cd10-8306-44b1-a295-9b532b1fe678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:14.750540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1350/2716] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:14.760626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:14.762198 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:14.941106 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:14.967802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26613-43ac-4842-89ef-0ed7da3ca3d5 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:14.972031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ece06-5680-483b-96ca-d1f8ef8770d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:14.972698 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ece06-5680-483b-96ca-d1f8ef8770d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:14.972975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ece06-5680-483b-96ca-d1f8ef8770d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:14.973269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ece06-5680-483b-96ca-d1f8ef8770d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:14.983324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ece06-5680-483b-96ca-d1f8ef8770d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:14.984792 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ece06-5680-483b-96ca-d1f8ef8770d1 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:14.995361 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1367/2717] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:26:15.270477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169cd10-8306-44b1-a295-9b532b1fe678 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:15.272236 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f169cd10-8306-44b1-a295-9b532b1fe678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:15.287710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169cd10-8306-44b1-a295-9b532b1fe678 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:15.293142 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:15.294237 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:15.294681 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:15.295166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] PATH_INFO: `/v3/projects/77c1b7cd94e34907884569dae0639fa3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:15.296683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c1b7cd94e34907884569dae0639fa3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:15.299197 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:15.352558 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c1b7cd94e34907884569dae0639fa3', 'request_id': 'req-863c7edb-9895-48ef-a65c-c3c597e499c4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.360869 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c1b7cd94e34907884569dae0639fa3', 'request_id': 'req-863c7edb-9895-48ef-a65c-c3c597e499c4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.366856 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c1b7cd94e34907884569dae0639fa3', 'request_id': 'req-863c7edb-9895-48ef-a65c-c3c597e499c4'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.378608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] The token cache is being invalidate because project 77c1b7cd94e34907884569dae0639fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:26:15.379078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.379876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.381430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1351/2718] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:26:15 2022] DELETE /identity/v3/projects/77c1b7cd94e34907884569dae0639fa3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:15.385524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ece06-5680-483b-96ca-d1f8ef8770d1 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:15.395941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ece06-5680-483b-96ca-d1f8ef8770d1 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:15.455193 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:15.455896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:15.456006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:15.456265 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] PATH_INFO: `/v3/users/6a8a004670a04f338eb216c78171e86c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:15.457524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8a004670a04f338eb216c78171e86c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:15.461297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:15.508909 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8a004670a04f338eb216c78171e86c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.509606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8a004670a04f338eb216c78171e86c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.522135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8a004670a04f338eb216c78171e86c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.529123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8a004670a04f338eb216c78171e86c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.537635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-c3f64dd3-e0bc-4c05-b482-41c0c4e47f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8a004670a04f338eb216c78171e86c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:15.544005 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1368/2719] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:26:15 2022] DELETE /identity/v3/users/6a8a004670a04f338eb216c78171e86c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:15.842203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:15.843753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:15.859127 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c7edb-9895-48ef-a65c-c3c597e499c4 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:15.887606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:15.936143 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:15.937243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:15.937696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:15.938297 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] PATH_INFO: `/v3/projects/0e152c6ab086475d959ab1821646f1f1` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:15.940355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e152c6ab086475d959ab1821646f1f1)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:15.943131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.001905 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e152c6ab086475d959ab1821646f1f1', 'request_id': 'req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:16.010726 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e152c6ab086475d959ab1821646f1f1', 'request_id': 'req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:16.017654 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e152c6ab086475d959ab1821646f1f1', 'request_id': 'req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:16.030359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] The token cache is being invalidate because project 0e152c6ab086475d959ab1821646f1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:26:16.031377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:16.032833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-dd5bd2f3-5e34-43f8-8282-b416dd1bc89d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:16.039428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1352/2720] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:26:15 2022] DELETE /identity/v3/projects/0e152c6ab086475d959ab1821646f1f1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:16.041358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd39b-0d57-4489-894b-f6615361f6f1 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.041731 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd39b-0d57-4489-894b-f6615361f6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.042123 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797cd39b-0d57-4489-894b-f6615361f6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.064160 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-797cd39b-0d57-4489-894b-f6615361f6f1 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:16.065479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-797cd39b-0d57-4489-894b-f6615361f6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:16.133555 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1369/2721] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:16.143711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b7b92-99a2-4eea-abc0-50ba1067bc32 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.144100 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b7b92-99a2-4eea-abc0-50ba1067bc32 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.144506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b7b92-99a2-4eea-abc0-50ba1067bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.168058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-261b7b92-99a2-4eea-abc0-50ba1067bc32 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:16.169370 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-261b7b92-99a2-4eea-abc0-50ba1067bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:16.180911 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1353/2722] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:26:16.182566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cd39b-0d57-4489-894b-f6615361f6f1 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.189690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:16.195375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797cd39b-0d57-4489-894b-f6615361f6f1 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.204364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.204996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.205448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.205730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.206404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:26:16.206740 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.208379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.221648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1370/2723] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:26:16.226460 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b7b92-99a2-4eea-abc0-50ba1067bc32 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.236988 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b7b92-99a2-4eea-abc0-50ba1067bc32 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.242347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0955da-84f3-4052-8f00-4aa431b36853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.243007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0955da-84f3-4052-8f00-4aa431b36853 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.243347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0955da-84f3-4052-8f00-4aa431b36853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.243709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0955da-84f3-4052-8f00-4aa431b36853 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.244388 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0955da-84f3-4052-8f00-4aa431b36853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.246389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0955da-84f3-4052-8f00-4aa431b36853 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.278761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1354/2724] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:26:16 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:16.283500 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.296851 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98caf34-1862-411b-b347-17de6251c8a7 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.363172 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ee494-41d9-47f7-ae84-1f19051fbd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.364626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ee494-41d9-47f7-ae84-1f19051fbd4c admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.365329 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ee494-41d9-47f7-ae84-1f19051fbd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.365699 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ee494-41d9-47f7-ae84-1f19051fbd4c admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.366433 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ee494-41d9-47f7-ae84-1f19051fbd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.368538 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ee494-41d9-47f7-ae84-1f19051fbd4c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.394137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1371/2725] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:26:16 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:16.398872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0955da-84f3-4052-8f00-4aa431b36853 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.411230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0955da-84f3-4052-8f00-4aa431b36853 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.415940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa233c-3b65-45f8-8649-b4c28a84c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.416623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa233c-3b65-45f8-8649-b4c28a84c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.416961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa233c-3b65-45f8-8649-b4c28a84c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.417394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa233c-3b65-45f8-8649-b4c28a84c9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.418109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa233c-3b65-45f8-8649-b4c28a84c9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.419787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa233c-3b65-45f8-8649-b4c28a84c9ee admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.430632 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1355/2726] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:26:16.434413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ee494-41d9-47f7-ae84-1f19051fbd4c admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.445255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ee494-41d9-47f7-ae84-1f19051fbd4c admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.450096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ca679-f8e0-4f44-840e-aa2abe7a76c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.450711 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca679-f8e0-4f44-840e-aa2abe7a76c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.450985 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca679-f8e0-4f44-840e-aa2abe7a76c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.451845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca679-f8e0-4f44-840e-aa2abe7a76c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.452494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ca679-f8e0-4f44-840e-aa2abe7a76c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.454094 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ca679-f8e0-4f44-840e-aa2abe7a76c1 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.464672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1372/2727] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:16.468909 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa233c-3b65-45f8-8649-b4c28a84c9ee admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.478923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa233c-3b65-45f8-8649-b4c28a84c9ee admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.484028 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e8a20-26d5-4713-95d9-436b46886358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.484682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e8a20-26d5-4713-95d9-436b46886358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.484957 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e8a20-26d5-4713-95d9-436b46886358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.485256 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e8a20-26d5-4713-95d9-436b46886358 admin admin] PATH_INFO: `/v3/projects/87ca9da7bf3045f6bfde67f44cccf36a/users/ddb2420cae8b4bc9ba95412abe3de096/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.500413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e8a20-26d5-4713-95d9-436b46886358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ca9da7bf3045f6bfde67f44cccf36a, user_id=ddb2420cae8b4bc9ba95412abe3de096, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.502987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e8a20-26d5-4713-95d9-436b46886358 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.517273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1356/2728] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:16 2022] PUT /identity/v3/projects/87ca9da7bf3045f6bfde67f44cccf36a/users/ddb2420cae8b4bc9ba95412abe3de096/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:16.587899 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c522-8fae-43f0-893a-ed89380d6937 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.588138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c522-8fae-43f0-893a-ed89380d6937 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.588442 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c522-8fae-43f0-893a-ed89380d6937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.617760 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ddd4c522-8fae-43f0-893a-ed89380d6937 None None] MFA Rules not processed for user `ddb2420cae8b4bc9ba95412abe3de096`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:16.619142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ddd4c522-8fae-43f0-893a-ed89380d6937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:16.687530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1373/2729] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:16.692273 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e8a20-26d5-4713-95d9-436b46886358 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.747434 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:16.761588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e8a20-26d5-4713-95d9-436b46886358 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.766507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d02c17-4b1d-47c9-981a-dba2653f75bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.767117 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d02c17-4b1d-47c9-981a-dba2653f75bf admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.767394 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d02c17-4b1d-47c9-981a-dba2653f75bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.767665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d02c17-4b1d-47c9-981a-dba2653f75bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.768295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d02c17-4b1d-47c9-981a-dba2653f75bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.770588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d02c17-4b1d-47c9-981a-dba2653f75bf admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.803057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1357/2730] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:26:16 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:16.804412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c522-8fae-43f0-893a-ed89380d6937 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.815579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c522-8fae-43f0-893a-ed89380d6937 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.877525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46837d92-bd50-440f-8e14-c738dd3e7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.878134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46837d92-bd50-440f-8e14-c738dd3e7d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.878409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46837d92-bd50-440f-8e14-c738dd3e7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.878786 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46837d92-bd50-440f-8e14-c738dd3e7d1b admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.879603 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46837d92-bd50-440f-8e14-c738dd3e7d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.881534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46837d92-bd50-440f-8e14-c738dd3e7d1b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.889824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:16.908589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1374/2731] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:26:16 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:16.909898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d02c17-4b1d-47c9-981a-dba2653f75bf admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.920345 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d02c17-4b1d-47c9-981a-dba2653f75bf admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.925827 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677d4c-03ba-43da-a58a-eddc09d195f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.926683 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677d4c-03ba-43da-a58a-eddc09d195f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.926950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677d4c-03ba-43da-a58a-eddc09d195f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.927225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9677d4c-03ba-43da-a58a-eddc09d195f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.927876 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677d4c-03ba-43da-a58a-eddc09d195f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.929595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9677d4c-03ba-43da-a58a-eddc09d195f2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.940562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1358/2732] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:26:16.944996 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46837d92-bd50-440f-8e14-c738dd3e7d1b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.955451 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46837d92-bd50-440f-8e14-c738dd3e7d1b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.960473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cecbdd-70de-4dbb-ac64-bddeab24bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.961206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cecbdd-70de-4dbb-ac64-bddeab24bc89 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.961622 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cecbdd-70de-4dbb-ac64-bddeab24bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.961900 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cecbdd-70de-4dbb-ac64-bddeab24bc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:16.962554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cecbdd-70de-4dbb-ac64-bddeab24bc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:16.964131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cecbdd-70de-4dbb-ac64-bddeab24bc89 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:16.977249 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1375/2733] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:16.978956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677d4c-03ba-43da-a58a-eddc09d195f2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:16.989408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9677d4c-03ba-43da-a58a-eddc09d195f2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:16.994607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2cca9-e635-4747-92f7-90253fbcd6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:16.995285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2cca9-e635-4747-92f7-90253fbcd6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:16.995562 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2cca9-e635-4747-92f7-90253fbcd6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:16.995844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2cca9-e635-4747-92f7-90253fbcd6e1 admin admin] PATH_INFO: `/v3/projects/299ddcd0adba44229f5afff30a05984b/users/2d0c9a01e2d9463b885cdee97ffd1a60/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.011280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2cca9-e635-4747-92f7-90253fbcd6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299ddcd0adba44229f5afff30a05984b, user_id=2d0c9a01e2d9463b885cdee97ffd1a60, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:17.014020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2cca9-e635-4747-92f7-90253fbcd6e1 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:17.028298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1359/2734] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:16 2022] PUT /identity/v3/projects/299ddcd0adba44229f5afff30a05984b/users/2d0c9a01e2d9463b885cdee97ffd1a60/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:17.039606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae24bde-fbf5-4d27-9ad3-b29b34c83c7c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.039889 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae24bde-fbf5-4d27-9ad3-b29b34c83c7c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.040276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae24bde-fbf5-4d27-9ad3-b29b34c83c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.070258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9ae24bde-fbf5-4d27-9ad3-b29b34c83c7c None None] MFA Rules not processed for user `2d0c9a01e2d9463b885cdee97ffd1a60`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:17.071477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9ae24bde-fbf5-4d27-9ad3-b29b34c83c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:17.137568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1376/2735] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:17.142114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2cca9-e635-4747-92f7-90253fbcd6e1 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:17.207064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2cca9-e635-4747-92f7-90253fbcd6e1 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:17.212961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38accd2-efc7-44b5-aef0-8571345291fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:17.213622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38accd2-efc7-44b5-aef0-8571345291fa admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.213898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38accd2-efc7-44b5-aef0-8571345291fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.214158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38accd2-efc7-44b5-aef0-8571345291fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.214787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38accd2-efc7-44b5-aef0-8571345291fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:17.216672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38accd2-efc7-44b5-aef0-8571345291fa admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:17.247290 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1360/2736] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:26:17 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:17.251620 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae24bde-fbf5-4d27-9ad3-b29b34c83c7c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:17.262970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae24bde-fbf5-4d27-9ad3-b29b34c83c7c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:17.322745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64013-85ff-4650-9c49-dd1d76e3ed0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:17.323350 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64013-85ff-4650-9c49-dd1d76e3ed0d admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.323704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64013-85ff-4650-9c49-dd1d76e3ed0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.323971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64013-85ff-4650-9c49-dd1d76e3ed0d admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.324601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64013-85ff-4650-9c49-dd1d76e3ed0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:17.326524 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e64013-85ff-4650-9c49-dd1d76e3ed0d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:17.349781 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1377/2737] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:26:17 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:17.353841 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38accd2-efc7-44b5-aef0-8571345291fa admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:17.364463 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38accd2-efc7-44b5-aef0-8571345291fa admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:17.369427 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd014-edd5-4812-88f8-4bd03b3d75ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:17.370027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd014-edd5-4812-88f8-4bd03b3d75ae admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.370299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd014-edd5-4812-88f8-4bd03b3d75ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.370566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd014-edd5-4812-88f8-4bd03b3d75ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.371202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfd014-edd5-4812-88f8-4bd03b3d75ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:17.372785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfd014-edd5-4812-88f8-4bd03b3d75ae admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:17.384299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1361/2738] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:17.388865 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64013-85ff-4650-9c49-dd1d76e3ed0d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:17.399446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64013-85ff-4650-9c49-dd1d76e3ed0d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:17.406170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bdedc-21d9-4b01-8802-1892db006604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:17.406838 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdedc-21d9-4b01-8802-1892db006604 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.407113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdedc-21d9-4b01-8802-1892db006604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.407382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bdedc-21d9-4b01-8802-1892db006604 admin admin] PATH_INFO: `/v3/projects/b7233b12e02443d2936a29c66d7facc7/users/bbef814784f2442cafc7b8e7a65fc9ad/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.423081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bdedc-21d9-4b01-8802-1892db006604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7233b12e02443d2936a29c66d7facc7, user_id=bbef814784f2442cafc7b8e7a65fc9ad, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:17.425751 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bdedc-21d9-4b01-8802-1892db006604 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:17.439955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1378/2739] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:17 2022] PUT /identity/v3/projects/b7233b12e02443d2936a29c66d7facc7/users/bbef814784f2442cafc7b8e7a65fc9ad/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:17.444060 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd014-edd5-4812-88f8-4bd03b3d75ae admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:17.453931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd014-edd5-4812-88f8-4bd03b3d75ae admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:17.510989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899b4bc-487d-4247-925a-b2808b11aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:17.511592 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b4bc-487d-4247-925a-b2808b11aa8d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.511871 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b4bc-487d-4247-925a-b2808b11aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.512140 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899b4bc-487d-4247-925a-b2808b11aa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.512781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b4bc-487d-4247-925a-b2808b11aa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:17.514401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899b4bc-487d-4247-925a-b2808b11aa8d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:17.525200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1362/2740] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:17.531189 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bdedc-21d9-4b01-8802-1892db006604 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:17.541845 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bdedc-21d9-4b01-8802-1892db006604 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:17.546916 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:17.547668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.547945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.548214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] PATH_INFO: `/v3/projects/b7233b12e02443d2936a29c66d7facc7/users/bbef814784f2442cafc7b8e7a65fc9ad/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.550178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7233b12e02443d2936a29c66d7facc7, user_id=bbef814784f2442cafc7b8e7a65fc9ad, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:17.552772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:17.562928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1379/2741] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:17 2022] PUT /identity/v3/projects/b7233b12e02443d2936a29c66d7facc7/users/bbef814784f2442cafc7b8e7a65fc9ad/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:26:17.574507 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046134a-e871-4c9f-9a20-a337f7457425 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.574737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046134a-e871-4c9f-9a20-a337f7457425 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.575135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046134a-e871-4c9f-9a20-a337f7457425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.602334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:17.611151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5046134a-e871-4c9f-9a20-a337f7457425 None None] MFA Rules not processed for user `bbef814784f2442cafc7b8e7a65fc9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:17.612610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5046134a-e871-4c9f-9a20-a337f7457425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:17.685455 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1363/2742] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:17.697386 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:17.699403 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:17.723040 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:17.760000 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07d201-fa31-404b-84d9-5e977a701cdc admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:17.763923 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f0738-deee-406a-83e1-2ccde77df066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:17.764515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f0738-deee-406a-83e1-2ccde77df066 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:17.765059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f0738-deee-406a-83e1-2ccde77df066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:17.765354 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f0738-deee-406a-83e1-2ccde77df066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:17.831217 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f0738-deee-406a-83e1-2ccde77df066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:17.832608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f0738-deee-406a-83e1-2ccde77df066 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:17.841631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1380/2743] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:26:19.385860 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046134a-e871-4c9f-9a20-a337f7457425 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:19.387350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5046134a-e871-4c9f-9a20-a337f7457425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:19.400016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046134a-e871-4c9f-9a20-a337f7457425 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:19.403731 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039915-22a1-43e6-900f-749c4fec140c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:19.404335 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039915-22a1-43e6-900f-749c4fec140c service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:19.404607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039915-22a1-43e6-900f-749c4fec140c service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:19.404887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039915-22a1-43e6-900f-749c4fec140c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:19.461781 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd039915-22a1-43e6-900f-749c4fec140c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:19.463120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd039915-22a1-43e6-900f-749c4fec140c service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:19.472126 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1364/2744] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:26:20.028432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f0738-deee-406a-83e1-2ccde77df066 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:20.037677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f0738-deee-406a-83e1-2ccde77df066 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:20.044754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187030b0-fb62-4bc8-bb6b-8d240fac36b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:20.045591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187030b0-fb62-4bc8-bb6b-8d240fac36b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:20.045914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187030b0-fb62-4bc8-bb6b-8d240fac36b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:20.046183 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187030b0-fb62-4bc8-bb6b-8d240fac36b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:20.059484 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187030b0-fb62-4bc8-bb6b-8d240fac36b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:20.060896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187030b0-fb62-4bc8-bb6b-8d240fac36b7 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:20.071811 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1381/2745] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:26:24.037766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039915-22a1-43e6-900f-749c4fec140c service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:24.130114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039915-22a1-43e6-900f-749c4fec140c service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:24.135637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:24.136280 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:24.136566 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:24.137125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] PATH_INFO: `/v3/users/ddb2420cae8b4bc9ba95412abe3de096` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:24.138372 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb2420cae8b4bc9ba95412abe3de096)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:24.140366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:24.193202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:24.205769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb2420cae8b4bc9ba95412abe3de096'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.224766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb2420cae8b4bc9ba95412abe3de096'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.233741 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb2420cae8b4bc9ba95412abe3de096'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.252722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb2420cae8b4bc9ba95412abe3de096'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.253383 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb2420cae8b4bc9ba95412abe3de096'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.260474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1365/2746] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:26:24 2022] DELETE /identity/v3/users/ddb2420cae8b4bc9ba95412abe3de096 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:24.265530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59530139-a859-44a7-8abf-6017b0178f32 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:24.266073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59530139-a859-44a7-8abf-6017b0178f32 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:24.266073 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59530139-a859-44a7-8abf-6017b0178f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:24.288352 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-59530139-a859-44a7-8abf-6017b0178f32 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:24.289677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-59530139-a859-44a7-8abf-6017b0178f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:24.364708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1382/2747] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:24.375975 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:24.377462 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:24.443119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3538-72cb-4c72-94ca-5ae7b5435f9d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:24.447223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a44b8-6576-4d98-ad5c-4f1d9190e2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:24.447944 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a44b8-6576-4d98-ad5c-4f1d9190e2de service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:24.448215 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a44b8-6576-4d98-ad5c-4f1d9190e2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:24.448486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a44b8-6576-4d98-ad5c-4f1d9190e2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:24.463744 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a44b8-6576-4d98-ad5c-4f1d9190e2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:24.465267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a44b8-6576-4d98-ad5c-4f1d9190e2de service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:24.482873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1366/2748] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:26:24.791496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59530139-a859-44a7-8abf-6017b0178f32 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:24.793400 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-59530139-a859-44a7-8abf-6017b0178f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:24.811358 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59530139-a859-44a7-8abf-6017b0178f32 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:24.817247 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:24.818079 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:24.818213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:24.818640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] PATH_INFO: `/v3/projects/87ca9da7bf3045f6bfde67f44cccf36a` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:24.820413 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ca9da7bf3045f6bfde67f44cccf36a)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:24.822913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:24.884651 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ca9da7bf3045f6bfde67f44cccf36a', 'request_id': 'req-1d60cdee-102e-47ce-aadf-ca6722db88bf'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.889665 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:24.891381 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ca9da7bf3045f6bfde67f44cccf36a', 'request_id': 'req-1d60cdee-102e-47ce-aadf-ca6722db88bf'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.898554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ca9da7bf3045f6bfde67f44cccf36a', 'request_id': 'req-1d60cdee-102e-47ce-aadf-ca6722db88bf'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.911997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] The token cache is being invalidate because project 87ca9da7bf3045f6bfde67f44cccf36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:26:24.912280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.912881 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:24.914392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1383/2749] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:26:24 2022] DELETE /identity/v3/projects/87ca9da7bf3045f6bfde67f44cccf36a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:24.918778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a44b8-6576-4d98-ad5c-4f1d9190e2de service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:24.929203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a44b8-6576-4d98-ad5c-4f1d9190e2de service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:24.988467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:24.989021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:24.989337 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:24.989606 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] PATH_INFO: `/v3/users/2d0c9a01e2d9463b885cdee97ffd1a60` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:24.990755 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0c9a01e2d9463b885cdee97ffd1a60)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:24.992672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:25.047845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0c9a01e2d9463b885cdee97ffd1a60'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.055705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:25.060815 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0c9a01e2d9463b885cdee97ffd1a60'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.068607 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0c9a01e2d9463b885cdee97ffd1a60'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.079439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0c9a01e2d9463b885cdee97ffd1a60'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.080091 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0c9a01e2d9463b885cdee97ffd1a60'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.086212 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1367/2750] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:26:24 2022] DELETE /identity/v3/users/2d0c9a01e2d9463b885cdee97ffd1a60 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:25.385722 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:25.387445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:25.402898 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60cdee-102e-47ce-aadf-ca6722db88bf admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:25.465104 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:25.465726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:25.466004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:25.466302 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] PATH_INFO: `/v3/projects/299ddcd0adba44229f5afff30a05984b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:25.467487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=299ddcd0adba44229f5afff30a05984b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:25.469440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:25.517945 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299ddcd0adba44229f5afff30a05984b', 'request_id': 'req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.526382 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299ddcd0adba44229f5afff30a05984b', 'request_id': 'req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.535575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299ddcd0adba44229f5afff30a05984b', 'request_id': 'req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.551187 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] The token cache is being invalidate because project 299ddcd0adba44229f5afff30a05984b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:26:25.551475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.552112 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.553632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1384/2751] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:26:25 2022] DELETE /identity/v3/projects/299ddcd0adba44229f5afff30a05984b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:25.558049 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:25.559596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:25.572734 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9161f7-f8e9-4855-a583-be1c743582d7 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:25.631031 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:25.631219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:25.631493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:25.631761 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] PATH_INFO: `/v3/users/bbef814784f2442cafc7b8e7a65fc9ad` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:25.633006 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbef814784f2442cafc7b8e7a65fc9ad)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:25.635401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:25.685571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbef814784f2442cafc7b8e7a65fc9ad'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.698366 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbef814784f2442cafc7b8e7a65fc9ad'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.705361 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbef814784f2442cafc7b8e7a65fc9ad'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.714124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbef814784f2442cafc7b8e7a65fc9ad'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.714884 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-2133a17e-4380-49ba-982a-16519fd84ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbef814784f2442cafc7b8e7a65fc9ad'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:25.721240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1368/2752] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:26:25 2022] DELETE /identity/v3/users/bbef814784f2442cafc7b8e7a65fc9ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:26.016861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:26.018404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:26.033006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6813b8f-39cf-47ae-a8b7-42ea878dd11e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:26.095419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:26.095958 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.096238 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.096501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] PATH_INFO: `/v3/projects/b7233b12e02443d2936a29c66d7facc7` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.097679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7233b12e02443d2936a29c66d7facc7)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:26.099567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:26.121269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:26.155583 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7233b12e02443d2936a29c66d7facc7', 'request_id': 'req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:26.161461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7233b12e02443d2936a29c66d7facc7', 'request_id': 'req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:26.167884 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7233b12e02443d2936a29c66d7facc7', 'request_id': 'req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:26.181636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] The token cache is being invalidate because project b7233b12e02443d2936a29c66d7facc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:26:26.181918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:26.182639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2a7ec5f0-012d-4e7b-9c42-cd9d75526ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:26:26.184293 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1385/2753] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:26:26 2022] DELETE /identity/v3/projects/b7233b12e02443d2936a29c66d7facc7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:26.189466 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b57c-8045-44a4-a3d2-83c2d6ce03e4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.189972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b57c-8045-44a4-a3d2-83c2d6ce03e4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.190207 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b57c-8045-44a4-a3d2-83c2d6ce03e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.210300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-08d5b57c-8045-44a4-a3d2-83c2d6ce03e4 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:26.211508 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-08d5b57c-8045-44a4-a3d2-83c2d6ce03e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:26.262106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:26.275510 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1369/2754] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:26.286022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b43b-cd8a-4e75-8d2a-eeba236875f0 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.286305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b43b-cd8a-4e75-8d2a-eeba236875f0 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.286579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b43b-cd8a-4e75-8d2a-eeba236875f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.307007 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-1573b43b-cd8a-4e75-8d2a-eeba236875f0 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:26.308234 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-1573b43b-cd8a-4e75-8d2a-eeba236875f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:26.316969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1386/2755] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:26.322068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5b57c-8045-44a4-a3d2-83c2d6ce03e4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:26.332945 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5b57c-8045-44a4-a3d2-83c2d6ce03e4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:26.338503 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:26.339114 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.339391 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.339664 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.340322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:26:26.340627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:26.342245 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:26.354669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1370/2756] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:26:26.359744 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573b43b-cd8a-4e75-8d2a-eeba236875f0 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:26.372882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573b43b-cd8a-4e75-8d2a-eeba236875f0 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:26.378798 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425d504-3c9e-425b-a7a1-5d33b2124c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:26.379392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425d504-3c9e-425b-a7a1-5d33b2124c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.379671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425d504-3c9e-425b-a7a1-5d33b2124c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.379942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425d504-3c9e-425b-a7a1-5d33b2124c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.380574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425d504-3c9e-425b-a7a1-5d33b2124c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:26.382518 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425d504-3c9e-425b-a7a1-5d33b2124c73 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:26.414445 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1387/2757] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:26:26.417677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:26.428334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9389-d806-4438-9998-e07711d1c50a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:26.489767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef484e3-5079-4b26-a5be-a1835f0f265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:26.490367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef484e3-5079-4b26-a5be-a1835f0f265e admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.490640 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef484e3-5079-4b26-a5be-a1835f0f265e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.490906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef484e3-5079-4b26-a5be-a1835f0f265e admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.491528 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef484e3-5079-4b26-a5be-a1835f0f265e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:26.493461 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef484e3-5079-4b26-a5be-a1835f0f265e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:26.521325 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1371/2758] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:26:26 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:26.526718 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425d504-3c9e-425b-a7a1-5d33b2124c73 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:26.538304 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425d504-3c9e-425b-a7a1-5d33b2124c73 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:26.544137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c57c-bf59-4948-ba5f-8c2bb58de543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:26.544736 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c57c-bf59-4948-ba5f-8c2bb58de543 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.545026 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c57c-bf59-4948-ba5f-8c2bb58de543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.545327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885c57c-bf59-4948-ba5f-8c2bb58de543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.545977 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885c57c-bf59-4948-ba5f-8c2bb58de543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:26.547579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885c57c-bf59-4948-ba5f-8c2bb58de543 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:26.558270 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1388/2759] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:26.562489 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef484e3-5079-4b26-a5be-a1835f0f265e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:26.572924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef484e3-5079-4b26-a5be-a1835f0f265e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:26.578544 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214e7a7-a9c0-4974-b28f-ffbb9ed2f72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:26.579148 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214e7a7-a9c0-4974-b28f-ffbb9ed2f72b admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.579425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214e7a7-a9c0-4974-b28f-ffbb9ed2f72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.579695 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214e7a7-a9c0-4974-b28f-ffbb9ed2f72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.580340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214e7a7-a9c0-4974-b28f-ffbb9ed2f72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:26.581984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214e7a7-a9c0-4974-b28f-ffbb9ed2f72b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:26.592862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1372/2760] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:26.598633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c57c-bf59-4948-ba5f-8c2bb58de543 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:26.609285 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885c57c-bf59-4948-ba5f-8c2bb58de543 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:26.614816 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:26.615516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.615789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.616056 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] PATH_INFO: `/v3/projects/6f638ebbcae444a7bfb899e9a332608b/users/ef37778a847842d282fdf3c5ab030029/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.631487 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f638ebbcae444a7bfb899e9a332608b, user_id=ef37778a847842d282fdf3c5ab030029, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:26.634357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:26.650264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1389/2761] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:26 2022] PUT /identity/v3/projects/6f638ebbcae444a7bfb899e9a332608b/users/ef37778a847842d282fdf3c5ab030029/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:26.656321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853aed4-cdf5-48d9-97a0-effc30d1961f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.656601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853aed4-cdf5-48d9-97a0-effc30d1961f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.656889 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853aed4-cdf5-48d9-97a0-effc30d1961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.676147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8853aed4-cdf5-48d9-97a0-effc30d1961f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:26.677377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8853aed4-cdf5-48d9-97a0-effc30d1961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:26.738903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1373/2762] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:26.749759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:26.751812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:26.811401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d412a-fbfb-4171-beca-615495754817 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:26.816004 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaef2ff-5095-4ace-a077-23416ae6d354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:26.816606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaef2ff-5095-4ace-a077-23416ae6d354 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:26.816879 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaef2ff-5095-4ace-a077-23416ae6d354 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:26.817167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaef2ff-5095-4ace-a077-23416ae6d354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:26.829419 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaef2ff-5095-4ace-a077-23416ae6d354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:26.831626 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaef2ff-5095-4ace-a077-23416ae6d354 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:26.844061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1390/2763] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:26:30.798564 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3cb02-46f7-4e6e-bf10-34c4f6d47cb4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:30.799074 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3cb02-46f7-4e6e-bf10-34c4f6d47cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:30.799363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3cb02-46f7-4e6e-bf10-34c4f6d47cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:30.833703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-14b3cb02-46f7-4e6e-bf10-34c4f6d47cb4 None None] MFA Rules not processed for user `ef37778a847842d282fdf3c5ab030029`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:30.835020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-14b3cb02-46f7-4e6e-bf10-34c4f6d47cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:30.889138 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:30.908347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1374/2764] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:30.912808 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaef2ff-5095-4ace-a077-23416ae6d354 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:30.923337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaef2ff-5095-4ace-a077-23416ae6d354 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:30.928734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b3034-936f-49ba-9a54-afc5c1203a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:30.929726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3034-936f-49ba-9a54-afc5c1203a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:30.930081 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3034-936f-49ba-9a54-afc5c1203a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:30.931503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3034-936f-49ba-9a54-afc5c1203a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:30.931503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b3034-936f-49ba-9a54-afc5c1203a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:30.933176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b3034-936f-49ba-9a54-afc5c1203a12 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:30.984107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3cb02-46f7-4e6e-bf10-34c4f6d47cb4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:30.985206 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1391/2765] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:26:30 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:30.999146 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3cb02-46f7-4e6e-bf10-34c4f6d47cb4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:31.069893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f33ee-e4dd-432a-9e10-abd6e4ba2d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:31.070519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f33ee-e4dd-432a-9e10-abd6e4ba2d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:31.070793 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f33ee-e4dd-432a-9e10-abd6e4ba2d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:31.071062 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f33ee-e4dd-432a-9e10-abd6e4ba2d0e admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:31.071698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f33ee-e4dd-432a-9e10-abd6e4ba2d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:31.073972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f33ee-e4dd-432a-9e10-abd6e4ba2d0e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:31.099599 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1375/2766] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:26:30 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:26:31.103730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b3034-936f-49ba-9a54-afc5c1203a12 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:31.114476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b3034-936f-49ba-9a54-afc5c1203a12 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:31.120452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308d1c2-73a0-460c-bb0d-a9e275c581ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:31.121114 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d1c2-73a0-460c-bb0d-a9e275c581ee admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:31.121398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d1c2-73a0-460c-bb0d-a9e275c581ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:31.121673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308d1c2-73a0-460c-bb0d-a9e275c581ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:31.122336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308d1c2-73a0-460c-bb0d-a9e275c581ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:31.123972 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308d1c2-73a0-460c-bb0d-a9e275c581ee admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:31.135327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1392/2767] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:31.139766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f33ee-e4dd-432a-9e10-abd6e4ba2d0e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:31.150196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f33ee-e4dd-432a-9e10-abd6e4ba2d0e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:31.155234 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba018f-1109-4c82-8c1a-0644d7ea4aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:31.156238 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba018f-1109-4c82-8c1a-0644d7ea4aea admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:31.156512 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba018f-1109-4c82-8c1a-0644d7ea4aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:31.156785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba018f-1109-4c82-8c1a-0644d7ea4aea admin admin] PATH_INFO: `/v3/projects/323020d2cc15498dba4da86937a023dd/users/451507b1078443da87e5097616338503/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:31.172633 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba018f-1109-4c82-8c1a-0644d7ea4aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=323020d2cc15498dba4da86937a023dd, user_id=451507b1078443da87e5097616338503, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:31.175311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba018f-1109-4c82-8c1a-0644d7ea4aea admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:31.190288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1376/2768] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:31 2022] PUT /identity/v3/projects/323020d2cc15498dba4da86937a023dd/users/451507b1078443da87e5097616338503/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:31.194377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308d1c2-73a0-460c-bb0d-a9e275c581ee admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:31.205239 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308d1c2-73a0-460c-bb0d-a9e275c581ee admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:31.218704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:31.271635 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151a45e-62e9-4095-b1a1-89be3ff02466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:31.272250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151a45e-62e9-4095-b1a1-89be3ff02466 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:31.272525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151a45e-62e9-4095-b1a1-89be3ff02466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:31.272789 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151a45e-62e9-4095-b1a1-89be3ff02466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:31.273458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151a45e-62e9-4095-b1a1-89be3ff02466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:31.275053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151a45e-62e9-4095-b1a1-89be3ff02466 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:31.287836 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1393/2769] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:26:31.292232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba018f-1109-4c82-8c1a-0644d7ea4aea admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:31.303266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba018f-1109-4c82-8c1a-0644d7ea4aea admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:31.308601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:31.309516 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:31.309863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:31.310174 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] PATH_INFO: `/v3/projects/323020d2cc15498dba4da86937a023dd/users/451507b1078443da87e5097616338503/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:31.312252 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323020d2cc15498dba4da86937a023dd, user_id=451507b1078443da87e5097616338503, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:31.315014 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:31.326629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1377/2770] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:26:31 2022] PUT /identity/v3/projects/323020d2cc15498dba4da86937a023dd/users/451507b1078443da87e5097616338503/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:26:35.645864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867ddd-acae-4409-b63f-80573d9ec462 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:35.646402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867ddd-acae-4409-b63f-80573d9ec462 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:35.646402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867ddd-acae-4409-b63f-80573d9ec462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:35.675654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d4867ddd-acae-4409-b63f-80573d9ec462 None None] MFA Rules not processed for user `451507b1078443da87e5097616338503`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:35.676968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d4867ddd-acae-4409-b63f-80573d9ec462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:35.751380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1394/2771] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:26:35.763311 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:35.765340 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:35.827790 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec5080-be0e-450f-aa61-fd12d7c3f126 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:35.831499 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f45db0ea864a3299cccd7a74b7271b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:35.832152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:35.832430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:35.832693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:35.895614 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:35.898912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:35.904707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:35.913124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1378/2772] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 05:26:36.055142 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a609ba-cf4b-45cb-892a-754fc0c57313 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:36.055888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a609ba-cf4b-45cb-892a-754fc0c57313 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:36.056039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a609ba-cf4b-45cb-892a-754fc0c57313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:36.086263 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d9a609ba-cf4b-45cb-892a-754fc0c57313 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:36.087520 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d9a609ba-cf4b-45cb-892a-754fc0c57313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:36.182309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1395/2773] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:26:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:36.231008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:36.232474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:36.314666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efba41-837a-47b8-86e1-92060aa0079a service glance] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:36.319648 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24011d62-e88c-48d9-87b8-eb1e08f93bff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:36.320321 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011d62-e88c-48d9-87b8-eb1e08f93bff service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:36.320595 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011d62-e88c-48d9-87b8-eb1e08f93bff service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:36.320862 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011d62-e88c-48d9-87b8-eb1e08f93bff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:36.329737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24011d62-e88c-48d9-87b8-eb1e08f93bff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:36.331334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24011d62-e88c-48d9-87b8-eb1e08f93bff service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:36.339936 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1379/2774] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:26:44.719255 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722797-4aae-4645-afb6-34970f247286 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:44.719794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722797-4aae-4645-afb6-34970f247286 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:44.719918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5722797-4aae-4645-afb6-34970f247286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:44.740530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-e5722797-4aae-4645-afb6-34970f247286 None None] MFA Rules not processed for user `ef37778a847842d282fdf3c5ab030029`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:44.741765 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e5722797-4aae-4645-afb6-34970f247286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:44.750119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1396/2775] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:26:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:45.276267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24011d62-e88c-48d9-87b8-eb1e08f93bff service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:45.337122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24011d62-e88c-48d9-87b8-eb1e08f93bff service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:45.341401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:45.342008 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:45.342277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:45.342536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:45.344401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:45.354118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:45.355806 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:45.364115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1380/2776] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:26:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:26:46.980031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d337-9b52-44fa-ba21-2d5be06db3e3 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:46.980574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d337-9b52-44fa-ba21-2d5be06db3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:46.980574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11d337-9b52-44fa-ba21-2d5be06db3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:47.002572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ef11d337-9b52-44fa-ba21-2d5be06db3e3 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:26:47.003788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ef11d337-9b52-44fa-ba21-2d5be06db3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:26:47.011848 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1397/2777] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Aug 31 05:26:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:26:47.024045 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:26:47.038135 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef530c-943e-495e-a140-8eb9efb38aa6 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:26:47.044959 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdabb50-ff3a-4da9-bde5-1feb651ca5da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:26:47.045866 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabb50-ff3a-4da9-bde5-1feb651ca5da service swift] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:26:47.046152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabb50-ff3a-4da9-bde5-1feb651ca5da service swift] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:26:47.046416 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabb50-ff3a-4da9-bde5-1feb651ca5da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:26:47.055303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdabb50-ff3a-4da9-bde5-1feb651ca5da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:26:47.056877 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdabb50-ff3a-4da9-bde5-1feb651ca5da service swift] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:26:47.065016 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1381/2778] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 05:26:56.995560 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:26:57.062067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=65 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:01.364791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d337-9b52-44fa-ba21-2d5be06db3e3 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:01.366300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ef11d337-9b52-44fa-ba21-2d5be06db3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:01.513544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11d337-9b52-44fa-ba21-2d5be06db3e3 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:01.520132 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:01.520738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:01.521020 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:01.521316 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:01.523325 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:01.536554 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:01.538269 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:01.549016 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1398/2779] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:07.810989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdabb50-ff3a-4da9-bde5-1feb651ca5da service swift] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:07.842155 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdabb50-ff3a-4da9-bde5-1feb651ca5da service swift] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:07.846493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:07.847125 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:07.847400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:07.847666 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:07.857316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:07.858819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:07.868601 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1382/2780] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:11.544641 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=63 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:15.724053 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:15.736001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd7f0f-acb6-42ec-bc20-4eb614a7e6bc service placement] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:15.743412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:15.744690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:15.745024 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:15.745877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:15.748200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:15.762088 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:15.764366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:15.780682 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1399/2781] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:15.781122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:15.781122 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:15.882596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c606a6b-99b8-42f8-a7fc-19eb18793043 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:15.888972 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:15.889661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:15.889933 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:15.890205 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] PATH_INFO: `/v3/users/fd4b6cdf2af34a3da05bbc4b0e8f699d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:15.891596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4b6cdf2af34a3da05bbc4b0e8f699d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:15.893625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:15.943656 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4b6cdf2af34a3da05bbc4b0e8f699d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:15.955404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4b6cdf2af34a3da05bbc4b0e8f699d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:15.962777 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4b6cdf2af34a3da05bbc4b0e8f699d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:15.971608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4b6cdf2af34a3da05bbc4b0e8f699d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:15.972480 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-a074e280-75d3-4be3-86df-ab02ef9aa66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4b6cdf2af34a3da05bbc4b0e8f699d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:15.979757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1383/2782] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:15 2022] DELETE /identity/v3/users/fd4b6cdf2af34a3da05bbc4b0e8f699d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:16.170888 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:16.184219 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df005-afd6-4f5e-90d2-1a7c9c046ca4 service placement] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:16.244406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:16.245032 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.245333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.245608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] PATH_INFO: `/v3/projects/35eddd085ac649ed9b6ad6278ebe0a10` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.246734 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35eddd085ac649ed9b6ad6278ebe0a10)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:16.248605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:16.309489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35eddd085ac649ed9b6ad6278ebe0a10', 'request_id': 'req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:16.315914 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35eddd085ac649ed9b6ad6278ebe0a10', 'request_id': 'req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:16.322284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35eddd085ac649ed9b6ad6278ebe0a10', 'request_id': 'req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:16.337414 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] The token cache is being invalidate because project 35eddd085ac649ed9b6ad6278ebe0a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:16.337701 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:16.338314 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-bd3d80ea-d1cb-4d71-b9b7-30f2974f157b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:16.339917 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1400/2783] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:16 2022] DELETE /identity/v3/projects/35eddd085ac649ed9b6ad6278ebe0a10 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:16.344991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f16e-23f5-4593-bec6-a9badddbeb60 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.345298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f16e-23f5-4593-bec6-a9badddbeb60 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.345568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830f16e-23f5-4593-bec6-a9badddbeb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.368757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:16.414058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4830f16e-23f5-4593-bec6-a9badddbeb60 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:16.415303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4830f16e-23f5-4593-bec6-a9badddbeb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:16.478863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1384/2784] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:16.488866 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ae8a-8588-431f-8805-4652ed86e2e7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.489182 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ae8a-8588-431f-8805-4652ed86e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.489455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ae8a-8588-431f-8805-4652ed86e2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.510670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-75d5ae8a-8588-431f-8805-4652ed86e2e7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:16.511871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-75d5ae8a-8588-431f-8805-4652ed86e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:16.522009 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1401/2785] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:16.527023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830f16e-23f5-4593-bec6-a9badddbeb60 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:16.543453 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830f16e-23f5-4593-bec6-a9badddbeb60 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:16.550922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:16.551530 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.551805 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.552071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.552720 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:27:16.553025 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:16.554672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:16.566895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1385/2786] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:27:16.571392 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5ae8a-8588-431f-8805-4652ed86e2e7 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:16.581640 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5ae8a-8588-431f-8805-4652ed86e2e7 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:16.587417 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b267d6-73c6-4e66-8f5c-19e24f6786a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:16.588010 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b267d6-73c6-4e66-8f5c-19e24f6786a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.588283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b267d6-73c6-4e66-8f5c-19e24f6786a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.588544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b267d6-73c6-4e66-8f5c-19e24f6786a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.589273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b267d6-73c6-4e66-8f5c-19e24f6786a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:16.591196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b267d6-73c6-4e66-8f5c-19e24f6786a0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:16.621499 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1402/2787] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:16 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:16.630517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:16.637073 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3205b1-a4bf-4be5-8329-966861bca1e0 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:16.704085 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b40d66-1574-4e6b-830f-0b2a6892f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:16.705020 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40d66-1574-4e6b-830f-0b2a6892f0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.705441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40d66-1574-4e6b-830f-0b2a6892f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.705814 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40d66-1574-4e6b-830f-0b2a6892f0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.707035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b40d66-1574-4e6b-830f-0b2a6892f0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:16.710206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b40d66-1574-4e6b-830f-0b2a6892f0d5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:16.737799 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1386/2788] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:16 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 05:27:16.741973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b267d6-73c6-4e66-8f5c-19e24f6786a0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:16.752709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b267d6-73c6-4e66-8f5c-19e24f6786a0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:16.758017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa8276-d53f-417d-9aea-980432f65f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:16.758613 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa8276-d53f-417d-9aea-980432f65f44 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.758896 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa8276-d53f-417d-9aea-980432f65f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.759167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa8276-d53f-417d-9aea-980432f65f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.759818 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa8276-d53f-417d-9aea-980432f65f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:16.761448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa8276-d53f-417d-9aea-980432f65f44 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:16.772252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1403/2789] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:16.776350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b40d66-1574-4e6b-830f-0b2a6892f0d5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:16.787787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b40d66-1574-4e6b-830f-0b2a6892f0d5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:16.793519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330523a-60a0-49da-a0af-7d078b0ea5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:16.794137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330523a-60a0-49da-a0af-7d078b0ea5db admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.794410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330523a-60a0-49da-a0af-7d078b0ea5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.794677 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330523a-60a0-49da-a0af-7d078b0ea5db admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.795318 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330523a-60a0-49da-a0af-7d078b0ea5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:16.797149 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330523a-60a0-49da-a0af-7d078b0ea5db admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:16.808837 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1387/2790] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:16.813871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa8276-d53f-417d-9aea-980432f65f44 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:16.824143 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa8276-d53f-417d-9aea-980432f65f44 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:16.829036 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:16.829730 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.829993 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.830274 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] PATH_INFO: `/v3/projects/3ae82743bc7345df903efd78f03097ba/users/ea97a2efe01944178964db9456c09800/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.846224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae82743bc7345df903efd78f03097ba, user_id=ea97a2efe01944178964db9456c09800, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:16.848856 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:16.863541 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1404/2791] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:16 2022] PUT /identity/v3/projects/3ae82743bc7345df903efd78f03097ba/users/ea97a2efe01944178964db9456c09800/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:16.875421 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373bc77-e8a4-4f54-979a-0d44393cb9d0 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:16.875707 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373bc77-e8a4-4f54-979a-0d44393cb9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:16.875980 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373bc77-e8a4-4f54-979a-0d44393cb9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:16.904598 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-7373bc77-e8a4-4f54-979a-0d44393cb9d0 None None] MFA Rules not processed for user `ea97a2efe01944178964db9456c09800`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:16.905923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7373bc77-e8a4-4f54-979a-0d44393cb9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:16.946751 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:16.971368 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1388/2792] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:16.983049 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:16.985158 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:17.008196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:17.103258 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a08f80-e4dd-45dc-a3ab-8b74d11af1ea admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:17.109566 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4bfbf-70cb-4aee-9cb6-31cb8dcb024d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:17.110173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4bfbf-70cb-4aee-9cb6-31cb8dcb024d service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:17.110446 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4bfbf-70cb-4aee-9cb6-31cb8dcb024d service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:17.110716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4bfbf-70cb-4aee-9cb6-31cb8dcb024d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:17.118749 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4bfbf-70cb-4aee-9cb6-31cb8dcb024d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:17.120336 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4bfbf-70cb-4aee-9cb6-31cb8dcb024d service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:17.129226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1405/2793] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:17.335906 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373bc77-e8a4-4f54-979a-0d44393cb9d0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:17.414192 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373bc77-e8a4-4f54-979a-0d44393cb9d0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:17.419243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:17.419874 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:17.420153 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:17.420422 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] PATH_INFO: `/v3/users/ea97a2efe01944178964db9456c09800` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:17.421622 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea97a2efe01944178964db9456c09800)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:17.423703 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:17.478542 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea97a2efe01944178964db9456c09800'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:17.491520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea97a2efe01944178964db9456c09800'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:17.498895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea97a2efe01944178964db9456c09800'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:17.508076 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea97a2efe01944178964db9456c09800'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:17.508760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea97a2efe01944178964db9456c09800'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:17.514926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1389/2794] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:17 2022] DELETE /identity/v3/users/ea97a2efe01944178964db9456c09800 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:17.519490 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6aebb-c4d5-4d04-9ade-602f0d344adb None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:17.519775 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6aebb-c4d5-4d04-9ade-602f0d344adb None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:17.520052 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6aebb-c4d5-4d04-9ade-602f0d344adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:17.540373 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-7ce6aebb-c4d5-4d04-9ade-602f0d344adb None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:17.541619 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7ce6aebb-c4d5-4d04-9ade-602f0d344adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:17.605284 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1406/2795] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:17.616636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:17.618129 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:17.688984 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c1af7-6939-41a7-8a25-2d80bf7a8af3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:17.692780 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de5b27-967a-465d-93ec-21363210ef09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:17.693428 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5b27-967a-465d-93ec-21363210ef09 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:17.693709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5b27-967a-465d-93ec-21363210ef09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:17.693981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de5b27-967a-465d-93ec-21363210ef09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:17.699868 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:17.704137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de5b27-967a-465d-93ec-21363210ef09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:17.705902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de5b27-967a-465d-93ec-21363210ef09 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:17.716850 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1390/2796] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:17.993913 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6aebb-c4d5-4d04-9ade-602f0d344adb None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:17.995398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-7ce6aebb-c4d5-4d04-9ade-602f0d344adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:18.008376 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6aebb-c4d5-4d04-9ade-602f0d344adb None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.013326 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.013939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.014689 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.014975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] PATH_INFO: `/v3/projects/3ae82743bc7345df903efd78f03097ba` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.016398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae82743bc7345df903efd78f03097ba)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.018469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.068431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae82743bc7345df903efd78f03097ba', 'request_id': 'req-9d043871-efd9-47ca-b74b-9ac27e6243b4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:18.073743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae82743bc7345df903efd78f03097ba', 'request_id': 'req-9d043871-efd9-47ca-b74b-9ac27e6243b4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:18.079791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae82743bc7345df903efd78f03097ba', 'request_id': 'req-9d043871-efd9-47ca-b74b-9ac27e6243b4'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:18.083409 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:18.095531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] The token cache is being invalidate because project 3ae82743bc7345df903efd78f03097ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:18.096080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:18.097019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-9d043871-efd9-47ca-b74b-9ac27e6243b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:18.098595 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1407/2797] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:17 2022] DELETE /identity/v3/projects/3ae82743bc7345df903efd78f03097ba => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:27:18.103587 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05737ba2-3b22-421b-b07b-5b00121d058e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.104086 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05737ba2-3b22-421b-b07b-5b00121d058e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.104202 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05737ba2-3b22-421b-b07b-5b00121d058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.124863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-05737ba2-3b22-421b-b07b-5b00121d058e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:18.126108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-05737ba2-3b22-421b-b07b-5b00121d058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:18.188705 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1391/2798] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:18.196874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd67d7-bf1d-45da-b0fb-d5618ccd03ff None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.197190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd67d7-bf1d-45da-b0fb-d5618ccd03ff None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.197458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd67d7-bf1d-45da-b0fb-d5618ccd03ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.218006 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8dfd67d7-bf1d-45da-b0fb-d5618ccd03ff None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:18.219443 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8dfd67d7-bf1d-45da-b0fb-d5618ccd03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:18.227226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1408/2799] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:18.231477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05737ba2-3b22-421b-b07b-5b00121d058e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.242037 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05737ba2-3b22-421b-b07b-5b00121d058e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.247116 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.247702 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.247998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.248272 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.248927 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:27:18.249262 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.250898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.265316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1392/2800] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:27:18.269670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd67d7-bf1d-45da-b0fb-d5618ccd03ff None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.280045 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd67d7-bf1d-45da-b0fb-d5618ccd03ff None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.286305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcec3a3-fe9a-47b1-9e80-1b692c7f1530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.286982 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcec3a3-fe9a-47b1-9e80-1b692c7f1530 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.287254 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcec3a3-fe9a-47b1-9e80-1b692c7f1530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.287515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcec3a3-fe9a-47b1-9e80-1b692c7f1530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.288220 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcec3a3-fe9a-47b1-9e80-1b692c7f1530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.290191 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcec3a3-fe9a-47b1-9e80-1b692c7f1530 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.320389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1409/2801] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:18.324669 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.335663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce2291-fbd7-4fdd-bad7-960262d89118 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.396693 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11311a-066d-45ab-9dcb-a205f559e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.397341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11311a-066d-45ab-9dcb-a205f559e467 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.397621 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11311a-066d-45ab-9dcb-a205f559e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.397912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11311a-066d-45ab-9dcb-a205f559e467 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.398538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11311a-066d-45ab-9dcb-a205f559e467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.400449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11311a-066d-45ab-9dcb-a205f559e467 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.428442 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1393/2802] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:18 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:18.432656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcec3a3-fe9a-47b1-9e80-1b692c7f1530 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.444213 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcec3a3-fe9a-47b1-9e80-1b692c7f1530 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.449974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431e304-d122-47c7-9684-df1a0c4e9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.450611 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431e304-d122-47c7-9684-df1a0c4e9dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.450886 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431e304-d122-47c7-9684-df1a0c4e9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.451155 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431e304-d122-47c7-9684-df1a0c4e9dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.451800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431e304-d122-47c7-9684-df1a0c4e9dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.453458 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431e304-d122-47c7-9684-df1a0c4e9dd0 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.464606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1410/2803] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:18.468890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11311a-066d-45ab-9dcb-a205f559e467 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.479520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11311a-066d-45ab-9dcb-a205f559e467 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.484997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3a19a-0174-4db3-a505-e586d5a6c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.485629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a19a-0174-4db3-a505-e586d5a6c5bc admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.485903 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a19a-0174-4db3-a505-e586d5a6c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.486169 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3a19a-0174-4db3-a505-e586d5a6c5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.486802 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3a19a-0174-4db3-a505-e586d5a6c5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.488395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3a19a-0174-4db3-a505-e586d5a6c5bc admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.499380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1394/2804] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:18.503831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431e304-d122-47c7-9684-df1a0c4e9dd0 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.514379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431e304-d122-47c7-9684-df1a0c4e9dd0 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.519389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bd930-eee7-4079-b625-93873f0861cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.520031 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd930-eee7-4079-b625-93873f0861cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.520308 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd930-eee7-4079-b625-93873f0861cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.520581 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd930-eee7-4079-b625-93873f0861cd admin admin] PATH_INFO: `/v3/projects/bc6567c6a74647e49faa6bf06cf09e00/users/00d66d698fff4837885aca6eb5d3f184/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.536023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bd930-eee7-4079-b625-93873f0861cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6567c6a74647e49faa6bf06cf09e00, user_id=00d66d698fff4837885aca6eb5d3f184, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.538708 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bd930-eee7-4079-b625-93873f0861cd admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.552832 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1411/2805] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:18 2022] PUT /identity/v3/projects/bc6567c6a74647e49faa6bf06cf09e00/users/00d66d698fff4837885aca6eb5d3f184/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:27:18.563240 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd4dc-d270-4e0b-8f4f-244737eecd1c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.563589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd4dc-d270-4e0b-8f4f-244737eecd1c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.563952 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dd4dc-d270-4e0b-8f4f-244737eecd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.591479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d86dd4dc-d270-4e0b-8f4f-244737eecd1c None None] MFA Rules not processed for user `00d66d698fff4837885aca6eb5d3f184`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:18.592608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d86dd4dc-d270-4e0b-8f4f-244737eecd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:18.645580 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:18.664956 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1395/2806] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:27:18.669670 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bd930-eee7-4079-b625-93873f0861cd admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.733616 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bd930-eee7-4079-b625-93873f0861cd admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.738648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113cee-79df-41c5-b2cb-7be2dca01cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.739250 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113cee-79df-41c5-b2cb-7be2dca01cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.739530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113cee-79df-41c5-b2cb-7be2dca01cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.739802 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0113cee-79df-41c5-b2cb-7be2dca01cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.740431 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0113cee-79df-41c5-b2cb-7be2dca01cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.742377 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0113cee-79df-41c5-b2cb-7be2dca01cc4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.773205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1412/2807] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:18.777396 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dd4dc-d270-4e0b-8f4f-244737eecd1c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.789064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dd4dc-d270-4e0b-8f4f-244737eecd1c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.847465 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871b44-7a06-4f0d-b0c8-a91d776686a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.847994 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871b44-7a06-4f0d-b0c8-a91d776686a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.848269 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871b44-7a06-4f0d-b0c8-a91d776686a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.848536 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871b44-7a06-4f0d-b0c8-a91d776686a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.849201 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d871b44-7a06-4f0d-b0c8-a91d776686a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.851121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d871b44-7a06-4f0d-b0c8-a91d776686a2 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.876013 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1396/2808] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:18 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:18.880299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113cee-79df-41c5-b2cb-7be2dca01cc4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.891529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0113cee-79df-41c5-b2cb-7be2dca01cc4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.897039 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab561c01-4b5f-47ec-a699-470a32ee3006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.897681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561c01-4b5f-47ec-a699-470a32ee3006 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.897955 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561c01-4b5f-47ec-a699-470a32ee3006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.898218 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab561c01-4b5f-47ec-a699-470a32ee3006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.898863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab561c01-4b5f-47ec-a699-470a32ee3006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.900459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab561c01-4b5f-47ec-a699-470a32ee3006 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.912511 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1413/2809] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:18.916958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871b44-7a06-4f0d-b0c8-a91d776686a2 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.927506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871b44-7a06-4f0d-b0c8-a91d776686a2 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:18.932918 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3745-ede4-472a-980d-315e505eec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:18.933625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3745-ede4-472a-980d-315e505eec49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:18.933896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3745-ede4-472a-980d-315e505eec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:18.934165 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3745-ede4-472a-980d-315e505eec49 admin admin] PATH_INFO: `/v3/projects/33a8066210ac47eb95f7d2607aec9a70/users/2ae53663939147789592f04ba6e7ca7c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:18.949478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d3745-ede4-472a-980d-315e505eec49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a8066210ac47eb95f7d2607aec9a70, user_id=2ae53663939147789592f04ba6e7ca7c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:18.952111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d3745-ede4-472a-980d-315e505eec49 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:18.966829 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1397/2810] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:18 2022] PUT /identity/v3/projects/33a8066210ac47eb95f7d2607aec9a70/users/2ae53663939147789592f04ba6e7ca7c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:18.971120 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab561c01-4b5f-47ec-a699-470a32ee3006 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:18.981368 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab561c01-4b5f-47ec-a699-470a32ee3006 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:19.055989 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a337ae-ac40-4900-a738-38dee1850735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:19.056681 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a337ae-ac40-4900-a738-38dee1850735 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:19.056859 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a337ae-ac40-4900-a738-38dee1850735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:19.057111 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a337ae-ac40-4900-a738-38dee1850735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:19.057794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a337ae-ac40-4900-a738-38dee1850735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:19.059356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a337ae-ac40-4900-a738-38dee1850735 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:19.070099 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1414/2811] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 05:27:19.075295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3745-ede4-472a-980d-315e505eec49 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:19.091985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3745-ede4-472a-980d-315e505eec49 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:19.098176 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:19.098757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:19.099033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:19.099295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] PATH_INFO: `/v3/projects/33a8066210ac47eb95f7d2607aec9a70/users/2ae53663939147789592f04ba6e7ca7c/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:19.101441 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a8066210ac47eb95f7d2607aec9a70, user_id=2ae53663939147789592f04ba6e7ca7c, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:19.104046 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:19.115417 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1398/2812] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:19 2022] PUT /identity/v3/projects/33a8066210ac47eb95f7d2607aec9a70/users/2ae53663939147789592f04ba6e7ca7c/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:19.127669 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952c223-2f72-495d-8757-370eea60c9bc None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:19.127928 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952c223-2f72-495d-8757-370eea60c9bc None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:19.128267 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952c223-2f72-495d-8757-370eea60c9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:19.135948 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:19.159992 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-9952c223-2f72-495d-8757-370eea60c9bc None None] MFA Rules not processed for user `2ae53663939147789592f04ba6e7ca7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:19.161227 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-9952c223-2f72-495d-8757-370eea60c9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:19.232241 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1415/2813] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:19.244403 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:19.247064 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:19.339351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826ebb5-9adb-47c1-82ac-8d2e42378f2e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:19.344310 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942dd61-e6b0-45cc-a5c0-ec5e897ce4ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:19.344924 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942dd61-e6b0-45cc-a5c0-ec5e897ce4ba service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:19.345232 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942dd61-e6b0-45cc-a5c0-ec5e897ce4ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:19.345501 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942dd61-e6b0-45cc-a5c0-ec5e897ce4ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:19.355043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942dd61-e6b0-45cc-a5c0-ec5e897ce4ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:19.356406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942dd61-e6b0-45cc-a5c0-ec5e897ce4ba service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:19.368692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1399/2814] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:19.810799 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952c223-2f72-495d-8757-370eea60c9bc None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:19.882671 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952c223-2f72-495d-8757-370eea60c9bc None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:19.887492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:19.888147 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:19.888398 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:19.888673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] PATH_INFO: `/v3/users/00d66d698fff4837885aca6eb5d3f184` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:19.889874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d66d698fff4837885aca6eb5d3f184)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:19.891819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:19.943098 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d66d698fff4837885aca6eb5d3f184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:19.943757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d66d698fff4837885aca6eb5d3f184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:19.956150 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d66d698fff4837885aca6eb5d3f184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:19.963615 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d66d698fff4837885aca6eb5d3f184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:19.972107 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d66d698fff4837885aca6eb5d3f184'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:19.978455 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1416/2815] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:19 2022] DELETE /identity/v3/users/00d66d698fff4837885aca6eb5d3f184 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:19.984069 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3d50c-4523-4ef3-b6f5-bef2474c2417 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:19.984449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3d50c-4523-4ef3-b6f5-bef2474c2417 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:19.984824 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3d50c-4523-4ef3-b6f5-bef2474c2417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:20.013152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d8e3d50c-4523-4ef3-b6f5-bef2474c2417 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:20.014836 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d8e3d50c-4523-4ef3-b6f5-bef2474c2417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:20.039568 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:20.082696 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1400/2816] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:20.092694 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:20.094546 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:20.105309 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:20.156956 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa9dea-ebea-4139-891d-e58eb3388b2d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:20.161582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163910b-8869-4c3a-93cc-03cbd49d93f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:20.162170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163910b-8869-4c3a-93cc-03cbd49d93f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:20.162447 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163910b-8869-4c3a-93cc-03cbd49d93f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:20.162720 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163910b-8869-4c3a-93cc-03cbd49d93f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:20.172644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163910b-8869-4c3a-93cc-03cbd49d93f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:20.174108 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163910b-8869-4c3a-93cc-03cbd49d93f7 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:20.183586 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1417/2817] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:20.477260 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3d50c-4523-4ef3-b6f5-bef2474c2417 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:20.478873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d8e3d50c-4523-4ef3-b6f5-bef2474c2417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:20.491362 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3d50c-4523-4ef3-b6f5-bef2474c2417 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:20.495979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:20.496620 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:20.497233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:20.497233 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] PATH_INFO: `/v3/projects/bc6567c6a74647e49faa6bf06cf09e00` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:20.498401 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6567c6a74647e49faa6bf06cf09e00)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:20.501216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:20.553967 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6567c6a74647e49faa6bf06cf09e00', 'request_id': 'req-28ce0708-790a-4db2-a10c-e6376555fabb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.562629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6567c6a74647e49faa6bf06cf09e00', 'request_id': 'req-28ce0708-790a-4db2-a10c-e6376555fabb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.569206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6567c6a74647e49faa6bf06cf09e00', 'request_id': 'req-28ce0708-790a-4db2-a10c-e6376555fabb'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.580753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] The token cache is being invalidate because project bc6567c6a74647e49faa6bf06cf09e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:20.581044 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.581724 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.583224 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1401/2818] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:20 2022] DELETE /identity/v3/projects/bc6567c6a74647e49faa6bf06cf09e00 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:20.587306 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163910b-8869-4c3a-93cc-03cbd49d93f7 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:20.596980 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163910b-8869-4c3a-93cc-03cbd49d93f7 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:20.657329 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:20.657960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:20.658237 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:20.658506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] PATH_INFO: `/v3/users/2ae53663939147789592f04ba6e7ca7c` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:20.659806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae53663939147789592f04ba6e7ca7c)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:20.661763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:20.720803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae53663939147789592f04ba6e7ca7c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.721630 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae53663939147789592f04ba6e7ca7c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.738215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae53663939147789592f04ba6e7ca7c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.745396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae53663939147789592f04ba6e7ca7c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.756464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-827d1100-40fa-4511-8731-ab047112ab8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae53663939147789592f04ba6e7ca7c'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:20.763372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1418/2819] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:20 2022] DELETE /identity/v3/users/2ae53663939147789592f04ba6e7ca7c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:21.040610 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.042063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:21.056382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce0708-790a-4db2-a10c-e6376555fabb admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.118348 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.118983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.119248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.119518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] PATH_INFO: `/v3/projects/33a8066210ac47eb95f7d2607aec9a70` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.120697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a8066210ac47eb95f7d2607aec9a70)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.122661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.171408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a8066210ac47eb95f7d2607aec9a70', 'request_id': 'req-10bb198f-ca97-4235-b6e6-915767cbbc9d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:21.172962 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:21.179885 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a8066210ac47eb95f7d2607aec9a70', 'request_id': 'req-10bb198f-ca97-4235-b6e6-915767cbbc9d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:21.187529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a8066210ac47eb95f7d2607aec9a70', 'request_id': 'req-10bb198f-ca97-4235-b6e6-915767cbbc9d'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:21.200223 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] The token cache is being invalidate because project 33a8066210ac47eb95f7d2607aec9a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:21.200543 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:21.201331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-10bb198f-ca97-4235-b6e6-915767cbbc9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:21.202970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1402/2820] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:21 2022] DELETE /identity/v3/projects/33a8066210ac47eb95f7d2607aec9a70 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:21.208170 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef25d9-431e-4366-9dbc-2f9d3b3d5779 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.208664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef25d9-431e-4366-9dbc-2f9d3b3d5779 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.208664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef25d9-431e-4366-9dbc-2f9d3b3d5779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.230363 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-77ef25d9-431e-4366-9dbc-2f9d3b3d5779 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:21.231588 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-77ef25d9-431e-4366-9dbc-2f9d3b3d5779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:21.260656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:21.302310 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1419/2821] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:21.311355 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b911-2ecf-4ce8-ad2d-7c84c42ad4b4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.311641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b911-2ecf-4ce8-ad2d-7c84c42ad4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.311912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430b911-2ecf-4ce8-ad2d-7c84c42ad4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.334139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b430b911-2ecf-4ce8-ad2d-7c84c42ad4b4 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:21.335345 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b430b911-2ecf-4ce8-ad2d-7c84c42ad4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:21.344963 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1403/2822] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:21.349457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef25d9-431e-4366-9dbc-2f9d3b3d5779 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.359596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef25d9-431e-4366-9dbc-2f9d3b3d5779 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.364692 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.365319 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.365600 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.365877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.366531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81574) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:27:21.366837 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.368408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.380664 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1420/2823] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:27:21.385119 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430b911-2ecf-4ce8-ad2d-7c84c42ad4b4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.395219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430b911-2ecf-4ce8-ad2d-7c84c42ad4b4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.401033 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26cc6e-3ffa-4d96-901c-42f0904773b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.401682 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cc6e-3ffa-4d96-901c-42f0904773b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.401958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cc6e-3ffa-4d96-901c-42f0904773b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.402200 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26cc6e-3ffa-4d96-901c-42f0904773b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.402844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26cc6e-3ffa-4d96-901c-42f0904773b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.404778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26cc6e-3ffa-4d96-901c-42f0904773b3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.437467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1404/2824] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:21 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:21.441759 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.452264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5081f7-bb9b-4bc4-8535-a7c6a520ca01 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.509952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416cc4-af34-4636-8588-47f712e3fe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.510562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416cc4-af34-4636-8588-47f712e3fe27 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.510827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416cc4-af34-4636-8588-47f712e3fe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.511080 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35416cc4-af34-4636-8588-47f712e3fe27 admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.511729 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35416cc4-af34-4636-8588-47f712e3fe27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.513686 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35416cc4-af34-4636-8588-47f712e3fe27 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.538748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1421/2825] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:21 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:21.543540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26cc6e-3ffa-4d96-901c-42f0904773b3 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.555124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26cc6e-3ffa-4d96-901c-42f0904773b3 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.560464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538615-ce82-4aa2-9f1c-56346e1d89e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.561061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538615-ce82-4aa2-9f1c-56346e1d89e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.561367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538615-ce82-4aa2-9f1c-56346e1d89e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.561631 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538615-ce82-4aa2-9f1c-56346e1d89e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.562268 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538615-ce82-4aa2-9f1c-56346e1d89e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.564011 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538615-ce82-4aa2-9f1c-56346e1d89e8 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.574496 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1405/2826] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:21.578742 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416cc4-af34-4636-8588-47f712e3fe27 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.589109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35416cc4-af34-4636-8588-47f712e3fe27 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.594513 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55be2d4-49e1-4ce3-9d54-80085014e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.595105 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55be2d4-49e1-4ce3-9d54-80085014e086 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.595395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55be2d4-49e1-4ce3-9d54-80085014e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.595666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55be2d4-49e1-4ce3-9d54-80085014e086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.596300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55be2d4-49e1-4ce3-9d54-80085014e086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.597921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55be2d4-49e1-4ce3-9d54-80085014e086 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.608835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1422/2827] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:21.613704 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538615-ce82-4aa2-9f1c-56346e1d89e8 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.630517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538615-ce82-4aa2-9f1c-56346e1d89e8 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.635709 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef912f5d-9f1c-41fa-b095-f31260cea39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.636375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912f5d-9f1c-41fa-b095-f31260cea39e admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.636651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912f5d-9f1c-41fa-b095-f31260cea39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.636923 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef912f5d-9f1c-41fa-b095-f31260cea39e admin admin] PATH_INFO: `/v3/projects/6990be457903435fa5e50753395079f7/users/e095f96c888c4edfb669ae1de4fa3dc5/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.652659 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912f5d-9f1c-41fa-b095-f31260cea39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6990be457903435fa5e50753395079f7, user_id=e095f96c888c4edfb669ae1de4fa3dc5, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.655347 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef912f5d-9f1c-41fa-b095-f31260cea39e admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.672641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1406/2828] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:21 2022] PUT /identity/v3/projects/6990be457903435fa5e50753395079f7/users/e095f96c888c4edfb669ae1de4fa3dc5/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:21.683109 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d685-41da-4aab-be37-1cb18f2ab90d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.683397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d685-41da-4aab-be37-1cb18f2ab90d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.683666 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847d685-41da-4aab-be37-1cb18f2ab90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.712176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-2847d685-41da-4aab-be37-1cb18f2ab90d None None] MFA Rules not processed for user `e095f96c888c4edfb669ae1de4fa3dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:21.713340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-2847d685-41da-4aab-be37-1cb18f2ab90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:21.777871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1423/2829] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:21.783412 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef912f5d-9f1c-41fa-b095-f31260cea39e admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.843495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef912f5d-9f1c-41fa-b095-f31260cea39e admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.848743 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e481-ae43-4750-b491-a73a8fc116b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.849371 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e481-ae43-4750-b491-a73a8fc116b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.849649 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e481-ae43-4750-b491-a73a8fc116b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.849893 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935e481-ae43-4750-b491-a73a8fc116b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.850549 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935e481-ae43-4750-b491-a73a8fc116b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.852448 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935e481-ae43-4750-b491-a73a8fc116b5 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.882479 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1407/2830] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:21 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:21.887297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847d685-41da-4aab-be37-1cb18f2ab90d None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:21.902592 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847d685-41da-4aab-be37-1cb18f2ab90d None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:21.926264 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:21.966028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7481-1b83-466d-9b5d-d7a7f066866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:21.966580 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7481-1b83-466d-9b5d-d7a7f066866a admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:21.966875 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7481-1b83-466d-9b5d-d7a7f066866a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:21.967130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba7481-1b83-466d-9b5d-d7a7f066866a admin admin] PATH_INFO: `/v3/users` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:21.967754 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba7481-1b83-466d-9b5d-d7a7f066866a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:21.969807 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba7481-1b83-466d-9b5d-d7a7f066866a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:21.992907 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1424/2831] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:21 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:21.997203 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e481-ae43-4750-b491-a73a8fc116b5 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:22.008415 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935e481-ae43-4750-b491-a73a8fc116b5 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:22.014111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d515f14-1429-49a1-8d00-89a11c47af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:22.014746 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515f14-1429-49a1-8d00-89a11c47af9a admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.015018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515f14-1429-49a1-8d00-89a11c47af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.015287 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d515f14-1429-49a1-8d00-89a11c47af9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.015979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d515f14-1429-49a1-8d00-89a11c47af9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:22.017819 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d515f14-1429-49a1-8d00-89a11c47af9a admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:22.028920 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1408/2832] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:22.033709 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7481-1b83-466d-9b5d-d7a7f066866a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:22.044494 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba7481-1b83-466d-9b5d-d7a7f066866a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:22.050394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8e0f-701b-4b96-b737-3d89ceaf6067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:22.051057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8e0f-701b-4b96-b737-3d89ceaf6067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.051335 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8e0f-701b-4b96-b737-3d89ceaf6067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.051606 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee8e0f-701b-4b96-b737-3d89ceaf6067 admin admin] PATH_INFO: `/v3/projects/ca5b34b6692444b09270ec27613841f7/users/ae5cd6ea7253428582a4689319fe9ff7/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.068223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee8e0f-701b-4b96-b737-3d89ceaf6067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5b34b6692444b09270ec27613841f7, user_id=ae5cd6ea7253428582a4689319fe9ff7, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:22.070924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee8e0f-701b-4b96-b737-3d89ceaf6067 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:22.086946 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1425/2833] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:22 2022] PUT /identity/v3/projects/ca5b34b6692444b09270ec27613841f7/users/ae5cd6ea7253428582a4689319fe9ff7/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:22.091339 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d515f14-1429-49a1-8d00-89a11c47af9a admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:22.103137 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d515f14-1429-49a1-8d00-89a11c47af9a admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:22.150193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:22.169266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db6dc6-8222-419b-b793-bc15d3912341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:22.170124 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db6dc6-8222-419b-b793-bc15d3912341 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.170473 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db6dc6-8222-419b-b793-bc15d3912341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.170854 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db6dc6-8222-419b-b793-bc15d3912341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.171766 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db6dc6-8222-419b-b793-bc15d3912341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:22.174486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db6dc6-8222-419b-b793-bc15d3912341 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:22.189106 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1409/2834] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:22.195704 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8e0f-701b-4b96-b737-3d89ceaf6067 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:22.212533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee8e0f-701b-4b96-b737-3d89ceaf6067 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:22.218252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:22.218970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.219223 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.219515 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] PATH_INFO: `/v3/projects/ca5b34b6692444b09270ec27613841f7/users/ae5cd6ea7253428582a4689319fe9ff7/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.221721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5b34b6692444b09270ec27613841f7, user_id=ae5cd6ea7253428582a4689319fe9ff7, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:22.224406 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:22.235553 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1426/2835] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:22 2022] PUT /identity/v3/projects/ca5b34b6692444b09270ec27613841f7/users/ae5cd6ea7253428582a4689319fe9ff7/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:22.246890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bf4b-3cd4-4d09-993a-29d9c37307c2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.247170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bf4b-3cd4-4d09-993a-29d9c37307c2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.247444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bf4b-3cd4-4d09-993a-29d9c37307c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.276451 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0008bf4b-3cd4-4d09-993a-29d9c37307c2 None None] MFA Rules not processed for user `ae5cd6ea7253428582a4689319fe9ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:22.277678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0008bf4b-3cd4-4d09-993a-29d9c37307c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:22.349382 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1410/2836] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:22.364047 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:22.366679 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:22.433834 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9ffa0-d17e-4c85-b13d-d471b7172c5e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:22.438135 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08a3a1-f06c-4e47-9e69-06e5492f8bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:22.438696 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a3a1-f06c-4e47-9e69-06e5492f8bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.438967 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a3a1-f06c-4e47-9e69-06e5492f8bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.439235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08a3a1-f06c-4e47-9e69-06e5492f8bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.448629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08a3a1-f06c-4e47-9e69-06e5492f8bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:22.450077 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08a3a1-f06c-4e47-9e69-06e5492f8bc0 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:22.460307 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1427/2837] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:22.498091 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008bf4b-3cd4-4d09-993a-29d9c37307c2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:22.564093 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008bf4b-3cd4-4d09-993a-29d9c37307c2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:22.569474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:22.570112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.570387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.570651 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] PATH_INFO: `/v3/users/e095f96c888c4edfb669ae1de4fa3dc5` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.571845 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e095f96c888c4edfb669ae1de4fa3dc5)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:22.573831 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:22.629692 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e095f96c888c4edfb669ae1de4fa3dc5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:22.642266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e095f96c888c4edfb669ae1de4fa3dc5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:22.647999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:22.650248 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e095f96c888c4edfb669ae1de4fa3dc5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:22.660469 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e095f96c888c4edfb669ae1de4fa3dc5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:22.661107 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e095f96c888c4edfb669ae1de4fa3dc5'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:22.667630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1411/2838] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:22 2022] DELETE /identity/v3/users/e095f96c888c4edfb669ae1de4fa3dc5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:22.675299 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f21ba-58fa-4d0b-98d0-0d1796bbf6df None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.675572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f21ba-58fa-4d0b-98d0-0d1796bbf6df None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.675918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f21ba-58fa-4d0b-98d0-0d1796bbf6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.701462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-736f21ba-58fa-4d0b-98d0-0d1796bbf6df None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:22.702673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-736f21ba-58fa-4d0b-98d0-0d1796bbf6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:22.765868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1428/2839] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:27:22.777875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:22.779870 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:22.838115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec6ebb-7bdd-4972-8e89-13a26606d405 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:22.842154 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37c90b-3c1f-4635-ac6c-1550bce7cfdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:22.842760 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c90b-3c1f-4635-ac6c-1550bce7cfdb service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:22.843035 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c90b-3c1f-4635-ac6c-1550bce7cfdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:22.843307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c90b-3c1f-4635-ac6c-1550bce7cfdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:22.853018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37c90b-3c1f-4635-ac6c-1550bce7cfdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:22.854482 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37c90b-3c1f-4635-ac6c-1550bce7cfdb service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:22.863977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1412/2840] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:23.152806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f21ba-58fa-4d0b-98d0-0d1796bbf6df None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:23.154493 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-736f21ba-58fa-4d0b-98d0-0d1796bbf6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:23.170228 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f21ba-58fa-4d0b-98d0-0d1796bbf6df None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:23.175585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:23.176226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:23.176501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:23.177303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] PATH_INFO: `/v3/projects/6990be457903435fa5e50753395079f7` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:23.178627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6990be457903435fa5e50753395079f7)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:23.180534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:23.196823 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:23.235437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6990be457903435fa5e50753395079f7', 'request_id': 'req-51a4220b-bb3b-45ad-93b2-18c29b71fb96'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.241209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6990be457903435fa5e50753395079f7', 'request_id': 'req-51a4220b-bb3b-45ad-93b2-18c29b71fb96'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.247375 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6990be457903435fa5e50753395079f7', 'request_id': 'req-51a4220b-bb3b-45ad-93b2-18c29b71fb96'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.260975 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] The token cache is being invalidate because project 6990be457903435fa5e50753395079f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:23.261296 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.261904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.263380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1429/2841] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:23 2022] DELETE /identity/v3/projects/6990be457903435fa5e50753395079f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:23.267589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37c90b-3c1f-4635-ac6c-1550bce7cfdb service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:23.277476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37c90b-3c1f-4635-ac6c-1550bce7cfdb service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:23.336090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:23.336715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:23.336985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:23.337285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] PATH_INFO: `/v3/users/ae5cd6ea7253428582a4689319fe9ff7` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:23.338493 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5cd6ea7253428582a4689319fe9ff7)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:23.340387 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:23.391432 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5cd6ea7253428582a4689319fe9ff7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.402979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5cd6ea7253428582a4689319fe9ff7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.410823 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5cd6ea7253428582a4689319fe9ff7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.420931 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5cd6ea7253428582a4689319fe9ff7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.421833 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-7e04d304-9a92-4efa-ab8b-2703f74a0758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5cd6ea7253428582a4689319fe9ff7'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.429541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1413/2842] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:23 2022] DELETE /identity/v3/users/ae5cd6ea7253428582a4689319fe9ff7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 05:27:23.715526 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:23.717103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:23.730505 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4220b-bb3b-45ad-93b2-18c29b71fb96 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:23.793885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:23.794432 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:23.794706 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:23.794974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] PATH_INFO: `/v3/projects/ca5b34b6692444b09270ec27613841f7` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:23.796200 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca5b34b6692444b09270ec27613841f7)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:23.798286 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:23.861208 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5b34b6692444b09270ec27613841f7', 'request_id': 'req-8930d3d4-4be4-45bc-8d83-ee0c04657e59'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.867567 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5b34b6692444b09270ec27613841f7', 'request_id': 'req-8930d3d4-4be4-45bc-8d83-ee0c04657e59'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.875901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5b34b6692444b09270ec27613841f7', 'request_id': 'req-8930d3d4-4be4-45bc-8d83-ee0c04657e59'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.894650 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] The token cache is being invalidate because project ca5b34b6692444b09270ec27613841f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:23.894924 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.895894 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-8930d3d4-4be4-45bc-8d83-ee0c04657e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:23.898067 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1430/2843] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:23 2022] DELETE /identity/v3/projects/ca5b34b6692444b09270ec27613841f7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:23.903954 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fc50a-cc54-4077-ac6a-0987cf05b654 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:23.904476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fc50a-cc54-4077-ac6a-0987cf05b654 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:23.904576 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fc50a-cc54-4077-ac6a-0987cf05b654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:23.934890 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b91fc50a-cc54-4077-ac6a-0987cf05b654 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:23.936380 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b91fc50a-cc54-4077-ac6a-0987cf05b654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:23.943322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:24.017258 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1414/2844] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:24.026357 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df434-88b4-4f23-bfee-e42ca93ce519 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.026643 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df434-88b4-4f23-bfee-e42ca93ce519 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.027065 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430df434-88b4-4f23-bfee-e42ca93ce519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.051329 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-430df434-88b4-4f23-bfee-e42ca93ce519 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:24.052477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-430df434-88b4-4f23-bfee-e42ca93ce519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:24.063531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1431/2845] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:24.070672 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fc50a-cc54-4077-ac6a-0987cf05b654 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.084118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fc50a-cc54-4077-ac6a-0987cf05b654 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.090643 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.091242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.091519 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.091904 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.094266 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:27:24.094686 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.096619 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.110334 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1415/2846] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:27:24.117320 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df434-88b4-4f23-bfee-e42ca93ce519 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.135389 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430df434-88b4-4f23-bfee-e42ca93ce519 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.142803 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc043-d7ad-4f8b-b90e-724101e1132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.143636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc043-d7ad-4f8b-b90e-724101e1132e admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.144091 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc043-d7ad-4f8b-b90e-724101e1132e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.144401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abc043-d7ad-4f8b-b90e-724101e1132e admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.145459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc043-d7ad-4f8b-b90e-724101e1132e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.148327 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abc043-d7ad-4f8b-b90e-724101e1132e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.181941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1432/2847] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:24 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:24.188433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.203356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60deb41a-3aa6-4713-9c41-edd6f5e8ef7d admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.284878 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95023b8e-e844-4f36-b419-c0e039347e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.285898 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95023b8e-e844-4f36-b419-c0e039347e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.286392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95023b8e-e844-4f36-b419-c0e039347e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.286895 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95023b8e-e844-4f36-b419-c0e039347e3f admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.287943 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95023b8e-e844-4f36-b419-c0e039347e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.290733 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95023b8e-e844-4f36-b419-c0e039347e3f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.319735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1416/2848] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:24 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:24.324340 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc043-d7ad-4f8b-b90e-724101e1132e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.331806 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:24.337791 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abc043-d7ad-4f8b-b90e-724101e1132e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.347244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a49e7-14bd-41b0-8aa7-0f5385d71e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.347904 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a49e7-14bd-41b0-8aa7-0f5385d71e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.348192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a49e7-14bd-41b0-8aa7-0f5385d71e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.348471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a49e7-14bd-41b0-8aa7-0f5385d71e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.349176 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a49e7-14bd-41b0-8aa7-0f5385d71e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.351464 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a49e7-14bd-41b0-8aa7-0f5385d71e43 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.368644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1433/2849] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:24.376591 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95023b8e-e844-4f36-b419-c0e039347e3f admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.387757 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95023b8e-e844-4f36-b419-c0e039347e3f admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.394300 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b4ab7-a499-44e5-852d-096c5e251d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.394926 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4ab7-a499-44e5-852d-096c5e251d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.395180 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4ab7-a499-44e5-852d-096c5e251d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.395464 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4ab7-a499-44e5-852d-096c5e251d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.396121 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b4ab7-a499-44e5-852d-096c5e251d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.397783 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b4ab7-a499-44e5-852d-096c5e251d65 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.414736 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1417/2850] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:24.419292 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a49e7-14bd-41b0-8aa7-0f5385d71e43 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.430741 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a49e7-14bd-41b0-8aa7-0f5385d71e43 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.441815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd722e1-0e29-4233-8213-eab63892615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.442508 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd722e1-0e29-4233-8213-eab63892615d admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.442812 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd722e1-0e29-4233-8213-eab63892615d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.443062 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd722e1-0e29-4233-8213-eab63892615d admin admin] PATH_INFO: `/v3/projects/1802465cd36f41678b42821610fee1d2/users/f8c447685ebc4c90b7245fcb05480a96/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.464394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd722e1-0e29-4233-8213-eab63892615d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1802465cd36f41678b42821610fee1d2, user_id=f8c447685ebc4c90b7245fcb05480a96, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.467115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd722e1-0e29-4233-8213-eab63892615d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.486301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1434/2851] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:24 2022] PUT /identity/v3/projects/1802465cd36f41678b42821610fee1d2/users/f8c447685ebc4c90b7245fcb05480a96/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:24.501785 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082280c-bbcb-4edf-9d2e-7f5cc43d5cee None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.502042 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082280c-bbcb-4edf-9d2e-7f5cc43d5cee None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.502341 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082280c-bbcb-4edf-9d2e-7f5cc43d5cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.536162 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3082280c-bbcb-4edf-9d2e-7f5cc43d5cee None None] MFA Rules not processed for user `f8c447685ebc4c90b7245fcb05480a96`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:24.537405 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3082280c-bbcb-4edf-9d2e-7f5cc43d5cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:24.616377 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1418/2852] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:27:24.620830 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd722e1-0e29-4233-8213-eab63892615d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.691817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd722e1-0e29-4233-8213-eab63892615d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.696639 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358fa0d-6782-482a-a6f2-984301a498f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.697294 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fa0d-6782-482a-a6f2-984301a498f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.697579 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fa0d-6782-482a-a6f2-984301a498f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.697854 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358fa0d-6782-482a-a6f2-984301a498f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.698549 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358fa0d-6782-482a-a6f2-984301a498f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.700425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358fa0d-6782-482a-a6f2-984301a498f2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.731782 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1435/2853] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:24 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:24.737569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082280c-bbcb-4edf-9d2e-7f5cc43d5cee None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.754588 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082280c-bbcb-4edf-9d2e-7f5cc43d5cee None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.759029 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:24.829374 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd95ba3-58ff-44d8-8dad-ad3bbb627270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.829991 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95ba3-58ff-44d8-8dad-ad3bbb627270 admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.830267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95ba3-58ff-44d8-8dad-ad3bbb627270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.830532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd95ba3-58ff-44d8-8dad-ad3bbb627270 admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.831143 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd95ba3-58ff-44d8-8dad-ad3bbb627270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.833041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd95ba3-58ff-44d8-8dad-ad3bbb627270 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.870402 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1419/2854] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:24 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:24.875434 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358fa0d-6782-482a-a6f2-984301a498f2 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.886476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358fa0d-6782-482a-a6f2-984301a498f2 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.892125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ad04-46c8-4fe3-a3f9-3fc13b4f25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.892835 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ad04-46c8-4fe3-a3f9-3fc13b4f25a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.893276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ad04-46c8-4fe3-a3f9-3fc13b4f25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.893525 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ad04-46c8-4fe3-a3f9-3fc13b4f25a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.894167 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7ad04-46c8-4fe3-a3f9-3fc13b4f25a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.895748 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7ad04-46c8-4fe3-a3f9-3fc13b4f25a4 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.913452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1436/2855] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:24.917716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd95ba3-58ff-44d8-8dad-ad3bbb627270 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.934021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd95ba3-58ff-44d8-8dad-ad3bbb627270 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:24.941375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b804b5-027f-4b6e-ad50-17a62d632a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:24.942039 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b804b5-027f-4b6e-ad50-17a62d632a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:24.942346 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b804b5-027f-4b6e-ad50-17a62d632a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:24.942623 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b804b5-027f-4b6e-ad50-17a62d632a18 admin admin] PATH_INFO: `/v3/projects/d9cc7fc87e4344ff9e5a8185f7e32d79/users/93694e7de0644978b21ec1c97b471c7b/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:24.959246 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b804b5-027f-4b6e-ad50-17a62d632a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cc7fc87e4344ff9e5a8185f7e32d79, user_id=93694e7de0644978b21ec1c97b471c7b, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:24.961997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b804b5-027f-4b6e-ad50-17a62d632a18 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:24.977367 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1420/2856] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:24 2022] PUT /identity/v3/projects/d9cc7fc87e4344ff9e5a8185f7e32d79/users/93694e7de0644978b21ec1c97b471c7b/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:24.981510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ad04-46c8-4fe3-a3f9-3fc13b4f25a4 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:24.992212 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7ad04-46c8-4fe3-a3f9-3fc13b4f25a4 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:25.064559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bfd05-b795-45ed-8440-bb6099c47f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:25.065192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bfd05-b795-45ed-8440-bb6099c47f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:25.065457 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bfd05-b795-45ed-8440-bb6099c47f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:25.065743 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bfd05-b795-45ed-8440-bb6099c47f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:25.066412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bfd05-b795-45ed-8440-bb6099c47f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:25.068030 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bfd05-b795-45ed-8440-bb6099c47f52 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:25.078788 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1437/2857] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:25.085312 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b804b5-027f-4b6e-ad50-17a62d632a18 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:25.099477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b804b5-027f-4b6e-ad50-17a62d632a18 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:25.105410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:25.106077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:25.106353 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:25.106625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] PATH_INFO: `/v3/projects/d9cc7fc87e4344ff9e5a8185f7e32d79/users/93694e7de0644978b21ec1c97b471c7b/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:25.108811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cc7fc87e4344ff9e5a8185f7e32d79, user_id=93694e7de0644978b21ec1c97b471c7b, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:25.111754 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:25.123111 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1421/2858] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:25 2022] PUT /identity/v3/projects/d9cc7fc87e4344ff9e5a8185f7e32d79/users/93694e7de0644978b21ec1c97b471c7b/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:25.190087 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a856-c4d3-4fbf-a140-102aa44643b0 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:25.190379 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a856-c4d3-4fbf-a140-102aa44643b0 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:25.190721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a856-c4d3-4fbf-a140-102aa44643b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:25.229772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-ee87a856-c4d3-4fbf-a140-102aa44643b0 None None] MFA Rules not processed for user `93694e7de0644978b21ec1c97b471c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:25.231003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ee87a856-c4d3-4fbf-a140-102aa44643b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:25.266739 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:25.311535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1438/2859] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:25.323589 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:25.325430 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:25.387647 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9d9c0-1fec-483c-b64c-4b194b0c2804 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:25.392145 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1eabb-0a0b-4e4d-8f4e-549dcf658f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:25.392791 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1eabb-0a0b-4e4d-8f4e-549dcf658f77 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:25.393061 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1eabb-0a0b-4e4d-8f4e-549dcf658f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:25.393356 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1eabb-0a0b-4e4d-8f4e-549dcf658f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:25.456495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1eabb-0a0b-4e4d-8f4e-549dcf658f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:25.457961 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1eabb-0a0b-4e4d-8f4e-549dcf658f77 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:25.467987 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1422/2860] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:26.849280 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87a856-c4d3-4fbf-a140-102aa44643b0 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:26.850784 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ee87a856-c4d3-4fbf-a140-102aa44643b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:26.863289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87a856-c4d3-4fbf-a140-102aa44643b0 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:26.866971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0126c-b730-442e-b532-418849ee9059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:26.867572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0126c-b730-442e-b532-418849ee9059 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:26.867844 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0126c-b730-442e-b532-418849ee9059 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:26.868113 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0126c-b730-442e-b532-418849ee9059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:26.877563 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0126c-b730-442e-b532-418849ee9059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:26.878974 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0126c-b730-442e-b532-418849ee9059 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:26.888584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1439/2861] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:30.744213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1eabb-0a0b-4e4d-8f4e-549dcf658f77 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:30.764990 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:30.818615 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1eabb-0a0b-4e4d-8f4e-549dcf658f77 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:30.824861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:30.825538 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:30.825787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:30.826054 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] PATH_INFO: `/v3/users/f8c447685ebc4c90b7245fcb05480a96` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:30.827478 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c447685ebc4c90b7245fcb05480a96)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:30.829767 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:30.881439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c447685ebc4c90b7245fcb05480a96'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:30.893540 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c447685ebc4c90b7245fcb05480a96'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:30.900408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c447685ebc4c90b7245fcb05480a96'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:30.908887 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c447685ebc4c90b7245fcb05480a96'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:30.909557 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c447685ebc4c90b7245fcb05480a96'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:30.915935 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1423/2862] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:30 2022] DELETE /identity/v3/users/f8c447685ebc4c90b7245fcb05480a96 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:30.921503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea19df-103c-4658-a6dc-bda3b001cdc7 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:30.922083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea19df-103c-4658-a6dc-bda3b001cdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:30.922436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea19df-103c-4658-a6dc-bda3b001cdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:30.947721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-58ea19df-103c-4658-a6dc-bda3b001cdc7 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:30.948897 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-58ea19df-103c-4658-a6dc-bda3b001cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:31.012412 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1440/2863] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:31.022392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:31.024063 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:31.084390 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e53850-675a-4a12-ab43-a447bcde2f72 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:31.088185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e68be3-5e71-43ef-af92-9e88b6c4efdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:31.088797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68be3-5e71-43ef-af92-9e88b6c4efdb service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:31.089057 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68be3-5e71-43ef-af92-9e88b6c4efdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:31.089373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e68be3-5e71-43ef-af92-9e88b6c4efdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:31.098586 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e68be3-5e71-43ef-af92-9e88b6c4efdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:31.100021 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e68be3-5e71-43ef-af92-9e88b6c4efdb service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:31.109322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1424/2864] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:31.398235 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea19df-103c-4658-a6dc-bda3b001cdc7 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:31.399700 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-58ea19df-103c-4658-a6dc-bda3b001cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:31.415672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea19df-103c-4658-a6dc-bda3b001cdc7 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:31.424510 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:31.425268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:31.425552 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:31.425819 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] PATH_INFO: `/v3/projects/1802465cd36f41678b42821610fee1d2` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:31.427100 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1802465cd36f41678b42821610fee1d2)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:31.429038 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:31.483305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1802465cd36f41678b42821610fee1d2', 'request_id': 'req-36a2e51f-8cb5-4c42-accf-17b025be4778'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.489401 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1802465cd36f41678b42821610fee1d2', 'request_id': 'req-36a2e51f-8cb5-4c42-accf-17b025be4778'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.495497 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1802465cd36f41678b42821610fee1d2', 'request_id': 'req-36a2e51f-8cb5-4c42-accf-17b025be4778'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.516645 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] The token cache is being invalidate because project 1802465cd36f41678b42821610fee1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:31.516983 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.517632 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.519173 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1441/2865] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:31 2022] DELETE /identity/v3/projects/1802465cd36f41678b42821610fee1d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:31.523410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e68be3-5e71-43ef-af92-9e88b6c4efdb service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:31.538983 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e68be3-5e71-43ef-af92-9e88b6c4efdb service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:31.575608 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:31.604132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:31.604764 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:31.605058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:31.605337 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] PATH_INFO: `/v3/users/93694e7de0644978b21ec1c97b471c7b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:31.606450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93694e7de0644978b21ec1c97b471c7b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:31.608365 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:31.657147 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93694e7de0644978b21ec1c97b471c7b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.668627 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93694e7de0644978b21ec1c97b471c7b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.675295 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93694e7de0644978b21ec1c97b471c7b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.691113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93694e7de0644978b21ec1c97b471c7b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.691913 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-1c1de4da-bab4-4e56-a2ce-a7fefae6bb38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93694e7de0644978b21ec1c97b471c7b'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:31.698078 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1425/2866] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:31 2022] DELETE /identity/v3/users/93694e7de0644978b21ec1c97b471c7b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:31.985885 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:31.987452 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:32.001529 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2e51f-8cb5-4c42-accf-17b025be4778 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.038029 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:32.063656 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.064297 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.064572 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.064846 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] PATH_INFO: `/v3/projects/d9cc7fc87e4344ff9e5a8185f7e32d79` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.066018 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cc7fc87e4344ff9e5a8185f7e32d79)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.067915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.118585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cc7fc87e4344ff9e5a8185f7e32d79', 'request_id': 'req-3eca47f1-4ed8-46bb-9bac-7544ecff502a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:32.124654 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cc7fc87e4344ff9e5a8185f7e32d79', 'request_id': 'req-3eca47f1-4ed8-46bb-9bac-7544ecff502a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:32.131477 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cc7fc87e4344ff9e5a8185f7e32d79', 'request_id': 'req-3eca47f1-4ed8-46bb-9bac-7544ecff502a'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:32.146882 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] The token cache is being invalidate because project d9cc7fc87e4344ff9e5a8185f7e32d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:32.147221 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:32.147795 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-3eca47f1-4ed8-46bb-9bac-7544ecff502a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:32.149428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1442/2867] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:31 2022] DELETE /identity/v3/projects/d9cc7fc87e4344ff9e5a8185f7e32d79 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:32.154603 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9fe9-0066-4a65-a805-7e853c44a405 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.155123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9fe9-0066-4a65-a805-7e853c44a405 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.155123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9fe9-0066-4a65-a805-7e853c44a405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.177426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-809c9fe9-0066-4a65-a805-7e853c44a405 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:32.178628 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-809c9fe9-0066-4a65-a805-7e853c44a405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:32.238828 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1426/2868] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:32.249925 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d8f9-49fe-44a3-90cf-14cdaa39f61f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.250215 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d8f9-49fe-44a3-90cf-14cdaa39f61f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.250479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d8f9-49fe-44a3-90cf-14cdaa39f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.271402 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-f9b8d8f9-49fe-44a3-90cf-14cdaa39f61f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:32.272638 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-f9b8d8f9-49fe-44a3-90cf-14cdaa39f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:32.282755 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1443/2869] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:32.287196 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c9fe9-0066-4a65-a805-7e853c44a405 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.297369 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c9fe9-0066-4a65-a805-7e853c44a405 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.302384 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.302982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.303257 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.303523 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.304172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:27:32.304467 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.306081 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.317971 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1427/2870] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:27:32.322605 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8d8f9-49fe-44a3-90cf-14cdaa39f61f None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.332276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8d8f9-49fe-44a3-90cf-14cdaa39f61f None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.337599 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1cf3c-c819-46c6-b334-05dfafd0b3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.338196 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1cf3c-c819-46c6-b334-05dfafd0b3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.338471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1cf3c-c819-46c6-b334-05dfafd0b3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.338738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1cf3c-c819-46c6-b334-05dfafd0b3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.339366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1cf3c-c819-46c6-b334-05dfafd0b3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.341283 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1cf3c-c819-46c6-b334-05dfafd0b3c2 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.371470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1444/2871] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:32 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:32.376350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.387298 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29da2b-3e12-4893-99b1-d609de8c54ec admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.433505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:32.454776 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7326a-ddea-4481-9a0c-98746b944a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.455652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7326a-ddea-4481-9a0c-98746b944a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.456036 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7326a-ddea-4481-9a0c-98746b944a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.456409 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7326a-ddea-4481-9a0c-98746b944a0b admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.457426 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7326a-ddea-4481-9a0c-98746b944a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.460532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7326a-ddea-4481-9a0c-98746b944a0b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.485782 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1428/2872] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:32 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:32.490353 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1cf3c-c819-46c6-b334-05dfafd0b3c2 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.502861 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1cf3c-c819-46c6-b334-05dfafd0b3c2 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.508022 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e0018-cb37-47a5-b403-0fa86d915bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.508631 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0018-cb37-47a5-b403-0fa86d915bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.508941 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0018-cb37-47a5-b403-0fa86d915bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.509273 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e0018-cb37-47a5-b403-0fa86d915bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.509918 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e0018-cb37-47a5-b403-0fa86d915bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.511506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e0018-cb37-47a5-b403-0fa86d915bd5 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.524970 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1445/2873] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:32.529152 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7326a-ddea-4481-9a0c-98746b944a0b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.540518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7326a-ddea-4481-9a0c-98746b944a0b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.546517 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b8b83-20b4-4432-92b7-cb48644d73e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.547282 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b8b83-20b4-4432-92b7-cb48644d73e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.547556 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b8b83-20b4-4432-92b7-cb48644d73e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.547821 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b8b83-20b4-4432-92b7-cb48644d73e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.548468 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b8b83-20b4-4432-92b7-cb48644d73e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.550091 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b8b83-20b4-4432-92b7-cb48644d73e3 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.562053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1429/2874] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:32.567633 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e0018-cb37-47a5-b403-0fa86d915bd5 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.578892 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e0018-cb37-47a5-b403-0fa86d915bd5 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.583825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56629676-77c1-432c-a278-8fba488b1662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.584489 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56629676-77c1-432c-a278-8fba488b1662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.584764 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56629676-77c1-432c-a278-8fba488b1662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.585028 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56629676-77c1-432c-a278-8fba488b1662 admin admin] PATH_INFO: `/v3/projects/bc2358244b6e45efb9eecd32e652b9f0/users/a892b8b99a7f4f6e956bed51dc34e55e/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.601369 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56629676-77c1-432c-a278-8fba488b1662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2358244b6e45efb9eecd32e652b9f0, user_id=a892b8b99a7f4f6e956bed51dc34e55e, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.603997 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56629676-77c1-432c-a278-8fba488b1662 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.618901 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1446/2875] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:32 2022] PUT /identity/v3/projects/bc2358244b6e45efb9eecd32e652b9f0/users/a892b8b99a7f4f6e956bed51dc34e55e/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:32.630872 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcda7f-6c97-4229-ad21-75ed78ba14a1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.631168 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcda7f-6c97-4229-ad21-75ed78ba14a1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.631425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcda7f-6c97-4229-ad21-75ed78ba14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.663865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a3bcda7f-6c97-4229-ad21-75ed78ba14a1 None None] MFA Rules not processed for user `a892b8b99a7f4f6e956bed51dc34e55e`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:32.665058 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a3bcda7f-6c97-4229-ad21-75ed78ba14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:32.741585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1430/2876] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 05:27:32.746324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56629676-77c1-432c-a278-8fba488b1662 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.822492 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56629676-77c1-432c-a278-8fba488b1662 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.828469 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06889b6-b14f-4105-9430-e552cdcf68ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.829345 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06889b6-b14f-4105-9430-e552cdcf68ff admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.829593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06889b6-b14f-4105-9430-e552cdcf68ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.829864 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06889b6-b14f-4105-9430-e552cdcf68ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.830506 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06889b6-b14f-4105-9430-e552cdcf68ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.832396 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06889b6-b14f-4105-9430-e552cdcf68ff admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.838475 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:32.867462 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1447/2877] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:32 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:32.872115 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcda7f-6c97-4229-ad21-75ed78ba14a1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.884230 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcda7f-6c97-4229-ad21-75ed78ba14a1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.943408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d7107-0318-4519-ada8-0386b3153a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.944023 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7107-0318-4519-ada8-0386b3153a2b admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.944301 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7107-0318-4519-ada8-0386b3153a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.944597 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d7107-0318-4519-ada8-0386b3153a2b admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.945242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d7107-0318-4519-ada8-0386b3153a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.947132 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d7107-0318-4519-ada8-0386b3153a2b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:32.969960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1431/2878] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:32 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:32.975585 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06889b6-b14f-4105-9430-e552cdcf68ff admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:32.988573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06889b6-b14f-4105-9430-e552cdcf68ff admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:32.994011 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a9a9-ea15-42cf-9a72-b5752247a85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:32.994644 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a9a9-ea15-42cf-9a72-b5752247a85a admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:32.994921 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a9a9-ea15-42cf-9a72-b5752247a85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:32.995192 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a9a9-ea15-42cf-9a72-b5752247a85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:32.995841 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a9a9-ea15-42cf-9a72-b5752247a85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:32.997498 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a9a9-ea15-42cf-9a72-b5752247a85a admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:33.008810 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1448/2879] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:33.013316 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d7107-0318-4519-ada8-0386b3153a2b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:33.023844 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d7107-0318-4519-ada8-0386b3153a2b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:33.029322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202008-1481-4d97-b786-61748b86fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:33.029999 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202008-1481-4d97-b786-61748b86fe17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:33.030277 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202008-1481-4d97-b786-61748b86fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:33.030569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae202008-1481-4d97-b786-61748b86fe17 admin admin] PATH_INFO: `/v3/projects/1d9ac73e69574a179fff66d2150c6170/users/674e17cbc7434d1c8be1ffb118f5e25e/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:33.046637 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202008-1481-4d97-b786-61748b86fe17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9ac73e69574a179fff66d2150c6170, user_id=674e17cbc7434d1c8be1ffb118f5e25e, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:33.049534 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae202008-1481-4d97-b786-61748b86fe17 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:33.064748 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1432/2880] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:33 2022] PUT /identity/v3/projects/1d9ac73e69574a179fff66d2150c6170/users/674e17cbc7434d1c8be1ffb118f5e25e/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:33.069236 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a9a9-ea15-42cf-9a72-b5752247a85a admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:33.080048 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a9a9-ea15-42cf-9a72-b5752247a85a admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:33.147574 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75473562-87be-4a7d-b168-f7b86b3176bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:33.148190 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75473562-87be-4a7d-b168-f7b86b3176bd admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:33.148470 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75473562-87be-4a7d-b168-f7b86b3176bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:33.148745 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75473562-87be-4a7d-b168-f7b86b3176bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:33.149425 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75473562-87be-4a7d-b168-f7b86b3176bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:33.151023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75473562-87be-4a7d-b168-f7b86b3176bd admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:33.161871 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1449/2881] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:33.166404 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202008-1481-4d97-b786-61748b86fe17 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:33.176770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae202008-1481-4d97-b786-61748b86fe17 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:33.182007 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:33.182663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:33.182941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:33.183214 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] PATH_INFO: `/v3/projects/1d9ac73e69574a179fff66d2150c6170/users/674e17cbc7434d1c8be1ffb118f5e25e/roles/6da07502c09e4fc8afb31b58e434479b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:33.185364 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9ac73e69574a179fff66d2150c6170, user_id=674e17cbc7434d1c8be1ffb118f5e25e, role_id=6da07502c09e4fc8afb31b58e434479b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:33.188255 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:33.199909 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1433/2882] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:33 2022] PUT /identity/v3/projects/1d9ac73e69574a179fff66d2150c6170/users/674e17cbc7434d1c8be1ffb118f5e25e/roles/6da07502c09e4fc8afb31b58e434479b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:33.210690 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443138ef-fe2c-4e81-a3ce-c574bdbafcfe None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:33.210973 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443138ef-fe2c-4e81-a3ce-c574bdbafcfe None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:33.211248 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443138ef-fe2c-4e81-a3ce-c574bdbafcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:33.242496 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-443138ef-fe2c-4e81-a3ce-c574bdbafcfe None None] MFA Rules not processed for user `674e17cbc7434d1c8be1ffb118f5e25e`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:33.243673 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-443138ef-fe2c-4e81-a3ce-c574bdbafcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:33.330815 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1450/2883] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:33.344327 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:33.346267 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:33.352079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:33.409116 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce331b-5219-440e-b1f5-a984c70be72c admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:33.413612 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568083b5-bc1d-4409-a4dd-b3ec76376800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:33.414228 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568083b5-bc1d-4409-a4dd-b3ec76376800 service cinder] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:33.414506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568083b5-bc1d-4409-a4dd-b3ec76376800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:33.414778 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568083b5-bc1d-4409-a4dd-b3ec76376800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:33.424725 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568083b5-bc1d-4409-a4dd-b3ec76376800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:33.426185 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568083b5-bc1d-4409-a4dd-b3ec76376800 service cinder] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:33.436960 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1434/2884] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:33.522262 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443138ef-fe2c-4e81-a3ce-c574bdbafcfe None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:33.533503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443138ef-fe2c-4e81-a3ce-c574bdbafcfe None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:33.538979 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd660d4-e272-484e-9018-1580d41c6156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:33.539591 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd660d4-e272-484e-9018-1580d41c6156 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:33.539868 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd660d4-e272-484e-9018-1580d41c6156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:33.540131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd660d4-e272-484e-9018-1580d41c6156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:33.599994 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:33.603119 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd660d4-e272-484e-9018-1580d41c6156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:33.606003 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd660d4-e272-484e-9018-1580d41c6156 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:33.617794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1451/2885] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:38.741899 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568083b5-bc1d-4409-a4dd-b3ec76376800 service cinder] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:38.814629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568083b5-bc1d-4409-a4dd-b3ec76376800 service cinder] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:38.819571 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:38.820208 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:38.820481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:38.820753 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] PATH_INFO: `/v3/users/a892b8b99a7f4f6e956bed51dc34e55e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:38.822424 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a892b8b99a7f4f6e956bed51dc34e55e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:38.824344 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:38.878584 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a892b8b99a7f4f6e956bed51dc34e55e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:38.890629 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a892b8b99a7f4f6e956bed51dc34e55e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:38.898091 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a892b8b99a7f4f6e956bed51dc34e55e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:38.909303 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a892b8b99a7f4f6e956bed51dc34e55e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:38.909977 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a892b8b99a7f4f6e956bed51dc34e55e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:38.916541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1435/2886] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:38 2022] DELETE /identity/v3/users/a892b8b99a7f4f6e956bed51dc34e55e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:38.921118 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474dad-2151-415f-afa6-a708056e5e77 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:38.921677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474dad-2151-415f-afa6-a708056e5e77 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:38.921677 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474dad-2151-415f-afa6-a708056e5e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:38.941531 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-fd474dad-2151-415f-afa6-a708056e5e77 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:38.942738 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fd474dad-2151-415f-afa6-a708056e5e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:39.010474 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1452/2887] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:39.021665 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:39.023381 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:39.052964 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:39.091437 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dfed9-924d-45a7-9a43-07d55440ea35 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:39.096315 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7487fb-2d77-4976-9322-21e2034b36d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:39.096939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7487fb-2d77-4976-9322-21e2034b36d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:39.097256 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7487fb-2d77-4976-9322-21e2034b36d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:39.097529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7487fb-2d77-4976-9322-21e2034b36d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:39.110109 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7487fb-2d77-4976-9322-21e2034b36d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:39.111554 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7487fb-2d77-4976-9322-21e2034b36d6 service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:39.123041 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1436/2888] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:39.427772 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474dad-2151-415f-afa6-a708056e5e77 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:39.429577 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-fd474dad-2151-415f-afa6-a708056e5e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:39.445790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474dad-2151-415f-afa6-a708056e5e77 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:39.451404 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:39.452059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:39.452366 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:39.452627 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] PATH_INFO: `/v3/projects/bc2358244b6e45efb9eecd32e652b9f0` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:39.454331 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2358244b6e45efb9eecd32e652b9f0)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:39.456804 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:39.517575 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2358244b6e45efb9eecd32e652b9f0', 'request_id': 'req-17106b7c-ab10-47df-86db-2cac9cf1a866'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.523471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2358244b6e45efb9eecd32e652b9f0', 'request_id': 'req-17106b7c-ab10-47df-86db-2cac9cf1a866'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.530130 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2358244b6e45efb9eecd32e652b9f0', 'request_id': 'req-17106b7c-ab10-47df-86db-2cac9cf1a866'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.545668 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] The token cache is being invalidate because project bc2358244b6e45efb9eecd32e652b9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:39.545960 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.546662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.549244 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1453/2889] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:39 2022] DELETE /identity/v3/projects/bc2358244b6e45efb9eecd32e652b9f0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:39.553710 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7487fb-2d77-4976-9322-21e2034b36d6 service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:39.563908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7487fb-2d77-4976-9322-21e2034b36d6 service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:39.643484 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:39.644131 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:39.644408 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:39.644676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] PATH_INFO: `/v3/users/674e17cbc7434d1c8be1ffb118f5e25e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:39.645865 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=674e17cbc7434d1c8be1ffb118f5e25e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:39.647784 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:39.701770 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674e17cbc7434d1c8be1ffb118f5e25e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.714719 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674e17cbc7434d1c8be1ffb118f5e25e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.722661 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674e17cbc7434d1c8be1ffb118f5e25e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.731331 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674e17cbc7434d1c8be1ffb118f5e25e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.731947 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-99afab57-15fe-45cd-9074-f4fd83468e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674e17cbc7434d1c8be1ffb118f5e25e'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:39.738681 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1437/2890] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:27:39 2022] DELETE /identity/v3/users/674e17cbc7434d1c8be1ffb118f5e25e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:40.022103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:40.023787 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:40.038301 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17106b7c-ab10-47df-86db-2cac9cf1a866 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:40.099083 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:40.099721 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.100002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.100276 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] PATH_INFO: `/v3/projects/1d9ac73e69574a179fff66d2150c6170` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.101480 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9ac73e69574a179fff66d2150c6170)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:40.103395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:40.132102 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:40.161801 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9ac73e69574a179fff66d2150c6170', 'request_id': 'req-2441b18a-5017-4491-954a-3c3a30b42a61'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:40.171467 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9ac73e69574a179fff66d2150c6170', 'request_id': 'req-2441b18a-5017-4491-954a-3c3a30b42a61'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:40.178516 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9ac73e69574a179fff66d2150c6170', 'request_id': 'req-2441b18a-5017-4491-954a-3c3a30b42a61'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:40.195059 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] The token cache is being invalidate because project 1d9ac73e69574a179fff66d2150c6170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:27:40.195426 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:40.196332 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-2441b18a-5017-4491-954a-3c3a30b42a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:27:40.198657 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1454/2891] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:27:40 2022] DELETE /identity/v3/projects/1d9ac73e69574a179fff66d2150c6170 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:40.203747 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257f12-c772-4a7b-8a87-b17d70c46e4a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.204848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257f12-c772-4a7b-8a87-b17d70c46e4a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.204848 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5257f12-c772-4a7b-8a87-b17d70c46e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.225675 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e5257f12-c772-4a7b-8a87-b17d70c46e4a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:40.227000 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e5257f12-c772-4a7b-8a87-b17d70c46e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:40.275043 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:40.299133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1438/2892] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:40.306978 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adf72d-322a-4d02-8e20-671b3ab6160c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.307268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adf72d-322a-4d02-8e20-671b3ab6160c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.307547 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adf72d-322a-4d02-8e20-671b3ab6160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.329820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-27adf72d-322a-4d02-8e20-671b3ab6160c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:40.331089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-27adf72d-322a-4d02-8e20-671b3ab6160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:40.339863 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1455/2893] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:40.344285 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5257f12-c772-4a7b-8a87-b17d70c46e4a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:40.355018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5257f12-c772-4a7b-8a87-b17d70c46e4a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:40.360242 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:40.360873 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.361253 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.361476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.362133 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 05:27:40.362433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:40.364067 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:40.376071 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1439/2894] 10.222.0.17 () {58 vars in 1153 bytes} [Wed Aug 31 05:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 05:27:40.380459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adf72d-322a-4d02-8e20-671b3ab6160c None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:40.390483 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adf72d-322a-4d02-8e20-671b3ab6160c None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:40.396476 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9926-2a50-4112-a895-d5b201dd84cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:40.397175 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9926-2a50-4112-a895-d5b201dd84cb admin admin] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.397473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9926-2a50-4112-a895-d5b201dd84cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.397723 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9926-2a50-4112-a895-d5b201dd84cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.398324 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c9926-2a50-4112-a895-d5b201dd84cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:40.400205 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c9926-2a50-4112-a895-d5b201dd84cb admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:40.430428 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1456/2895] 10.222.0.17 () {60 vars in 1153 bytes} [Wed Aug 31 05:27:40 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:40.435068 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:40.445932 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06909077-d0d9-4449-8e28-7006e2db6330 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:40.504324 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b5bf-9c46-4152-a2a2-0fbf5db2340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:40.505389 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b5bf-9c46-4152-a2a2-0fbf5db2340b admin admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.505652 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b5bf-9c46-4152-a2a2-0fbf5db2340b admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.505922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b5bf-9c46-4152-a2a2-0fbf5db2340b admin admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.506585 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22b5bf-9c46-4152-a2a2-0fbf5db2340b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:40.508978 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22b5bf-9c46-4152-a2a2-0fbf5db2340b admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:40.534711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1440/2896] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Aug 31 05:27:40 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 05:27:40.541057 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9926-2a50-4112-a895-d5b201dd84cb admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:40.554877 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9926-2a50-4112-a895-d5b201dd84cb admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:40.560437 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1332a6-293d-4df3-a65b-b3bcba97e35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:40.561055 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1332a6-293d-4df3-a65b-b3bcba97e35b admin admin] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.561372 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1332a6-293d-4df3-a65b-b3bcba97e35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.561649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1332a6-293d-4df3-a65b-b3bcba97e35b admin admin] PATH_INFO: `/v3/roles` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.562303 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1332a6-293d-4df3-a65b-b3bcba97e35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:40.563971 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1332a6-293d-4df3-a65b-b3bcba97e35b admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:40.574593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1457/2897] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:40.580118 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b5bf-9c46-4152-a2a2-0fbf5db2340b admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:40.590505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b5bf-9c46-4152-a2a2-0fbf5db2340b admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:40.596309 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e713da-5c9f-4fc8-a567-af0dac0de51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:40.596900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e713da-5c9f-4fc8-a567-af0dac0de51f admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.597210 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e713da-5c9f-4fc8-a567-af0dac0de51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.597474 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e713da-5c9f-4fc8-a567-af0dac0de51f admin admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.598113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e713da-5c9f-4fc8-a567-af0dac0de51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:40.599701 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e713da-5c9f-4fc8-a567-af0dac0de51f admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:40.613139 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1441/2898] 10.222.0.17 () {58 vars in 1122 bytes} [Wed Aug 31 05:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 05:27:40.617460 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1332a6-293d-4df3-a65b-b3bcba97e35b admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:40.628145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1332a6-293d-4df3-a65b-b3bcba97e35b admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:40.633568 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:40.634224 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] REQUEST_METHOD: `PUT` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.634528 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.634800 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] PATH_INFO: `/v3/projects/3458b362dab6403bb0edb23cbbfdb53e/users/31f4904c33ee407cb20f9aef3ab602e9/roles/d2a6b97a907440368eca7f9387b778d6` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.652137 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3458b362dab6403bb0edb23cbbfdb53e, user_id=31f4904c33ee407cb20f9aef3ab602e9, role_id=d2a6b97a907440368eca7f9387b778d6)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:40.654794 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:40.670530 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1458/2899] 10.222.0.17 () {60 vars in 1483 bytes} [Wed Aug 31 05:27:40 2022] PUT /identity/v3/projects/3458b362dab6403bb0edb23cbbfdb53e/users/31f4904c33ee407cb20f9aef3ab602e9/roles/d2a6b97a907440368eca7f9387b778d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:27:40.676447 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603de97-9bc5-4202-9a6c-c1dec2a4875e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.676745 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603de97-9bc5-4202-9a6c-c1dec2a4875e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.677022 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603de97-9bc5-4202-9a6c-c1dec2a4875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.698222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b603de97-9bc5-4202-9a6c-c1dec2a4875e None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:40.699505 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b603de97-9bc5-4202-9a6c-c1dec2a4875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:40.764079 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1442/2900] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:40.775589 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:40.777629 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:40.850289 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf863-28a8-40b1-a318-5c4e6097057d admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:40.855534 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:40.856156 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:40.856429 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:40.856713 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:40.871662 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:40.873601 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:40.886648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1459/2901] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:41.594582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e022065-64ee-493a-89dc-555f6b64696e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:41.595406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e022065-64ee-493a-89dc-555f6b64696e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:41.595406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e022065-64ee-493a-89dc-555f6b64696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:41.631697 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6e022065-64ee-493a-89dc-555f6b64696e None None] MFA Rules not processed for user `31f4904c33ee407cb20f9aef3ab602e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:41.632970 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6e022065-64ee-493a-89dc-555f6b64696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:41.678880 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:41.703373 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1443/2902] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:41.715096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:27:41.716573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:41.774716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:41.779364 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437c282-1bb3-43a7-b8cb-b676a24e1b67 service neutron] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:27:41.784672 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6bd3f-e84a-435f-aca2-636033426f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:27:41.785383 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bd3f-e84a-435f-aca2-636033426f75 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:41.785962 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bd3f-e84a-435f-aca2-636033426f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:41.786288 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6bd3f-e84a-435f-aca2-636033426f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:41.795984 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6bd3f-e84a-435f-aca2-636033426f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:27:41.797459 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6bd3f-e84a-435f-aca2-636033426f75 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:27:41.806441 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1460/2903] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:27:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:27:43.204406 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f15bc-971b-4f20-89b6-35d182c3b442 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:27:43.204930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f15bc-971b-4f20-89b6-35d182c3b442 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:27:43.204930 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f15bc-971b-4f20-89b6-35d182c3b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:27:43.226017 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0f3f15bc-971b-4f20-89b6-35d182c3b442 None None] MFA Rules not processed for user `31f4904c33ee407cb20f9aef3ab602e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:27:43.227217 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0f3f15bc-971b-4f20-89b6-35d182c3b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:27:43.234811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1444/2904] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:27:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:27:51.802440 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=4 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:27:53.219735 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=11 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:09.895785 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5d32-e3de-4c0f-b69d-eba2ef9122f6 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:09.896436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5d32-e3de-4c0f-b69d-eba2ef9122f6 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:09.896436 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5d32-e3de-4c0f-b69d-eba2ef9122f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:09.918295 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-085a5d32-e3de-4c0f-b69d-eba2ef9122f6 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:09.919495 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-085a5d32-e3de-4c0f-b69d-eba2ef9122f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:09.930363 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1461/2905] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:09.946374 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f15bc-971b-4f20-89b6-35d182c3b442 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:09.948027 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0f3f15bc-971b-4f20-89b6-35d182c3b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:10.023680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f15bc-971b-4f20-89b6-35d182c3b442 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:10.030050 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:10.030663 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:10.030940 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:10.031209 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:10.040075 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:10.041691 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:10.051413 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1445/2906] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:12.998573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e6c5-8cd6-486f-af45-82f199c8fee5 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:12.999174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e6c5-8cd6-486f-af45-82f199c8fee5 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:12.999174 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4e6c5-8cd6-486f-af45-82f199c8fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:13.021683 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a8a4e6c5-8cd6-486f-af45-82f199c8fee5 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:13.023017 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a8a4e6c5-8cd6-486f-af45-82f199c8fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:13.032817 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1462/2907] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:13.051616 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:13.053392 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:13.072342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1d39f-f2a4-43e0-948a-30efe18c36ea service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:13.078997 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c96ec-2071-41c4-a3ed-0b994ef337a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:13.079582 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c96ec-2071-41c4-a3ed-0b994ef337a3 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:13.079882 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c96ec-2071-41c4-a3ed-0b994ef337a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:13.080151 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c96ec-2071-41c4-a3ed-0b994ef337a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:13.089158 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c96ec-2071-41c4-a3ed-0b994ef337a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:13.090772 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c96ec-2071-41c4-a3ed-0b994ef337a3 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:13.100532 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1446/2908] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:16.264949 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcd58a-16b7-4b03-8662-58eb2e60389c None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:16.265556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcd58a-16b7-4b03-8662-58eb2e60389c None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:16.265556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcd58a-16b7-4b03-8662-58eb2e60389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:16.286988 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-d7fcd58a-16b7-4b03-8662-58eb2e60389c None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:16.288796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d7fcd58a-16b7-4b03-8662-58eb2e60389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:16.298408 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1463/2909] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:16.312883 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c96ec-2071-41c4-a3ed-0b994ef337a3 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:16.325902 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c96ec-2071-41c4-a3ed-0b994ef337a3 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:16.336958 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db73380-028c-47c1-bf16-2fa42a22182e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:16.338120 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db73380-028c-47c1-bf16-2fa42a22182e service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:16.338515 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db73380-028c-47c1-bf16-2fa42a22182e service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:16.338912 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db73380-028c-47c1-bf16-2fa42a22182e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:16.351680 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db73380-028c-47c1-bf16-2fa42a22182e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:16.353350 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db73380-028c-47c1-bf16-2fa42a22182e service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:16.363700 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1447/2910] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:19.399933 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2b75-b7d2-4ba2-b79c-e64e42d3c6b2 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:19.400471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2b75-b7d2-4ba2-b79c-e64e42d3c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:19.400471 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d2b75-b7d2-4ba2-b79c-e64e42d3c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:19.423023 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-e78d2b75-b7d2-4ba2-b79c-e64e42d3c6b2 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:19.424305 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-e78d2b75-b7d2-4ba2-b79c-e64e42d3c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:19.433334 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1464/2911] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:19.451264 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db73380-028c-47c1-bf16-2fa42a22182e service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:19.463798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db73380-028c-47c1-bf16-2fa42a22182e service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:19.470966 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774587ba-8cf4-4a46-9825-58921236a0f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:19.471590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774587ba-8cf4-4a46-9825-58921236a0f7 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:19.471981 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774587ba-8cf4-4a46-9825-58921236a0f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:19.472292 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774587ba-8cf4-4a46-9825-58921236a0f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:19.482123 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774587ba-8cf4-4a46-9825-58921236a0f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:19.483732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774587ba-8cf4-4a46-9825-58921236a0f7 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:19.495270 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1448/2912] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:22.600936 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedabb-a557-4777-95c2-f22aa7b6784f None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:22.601472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedabb-a557-4777-95c2-f22aa7b6784f None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:22.601472 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eedabb-a557-4777-95c2-f22aa7b6784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:22.622649 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-42eedabb-a557-4777-95c2-f22aa7b6784f None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:22.623827 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-42eedabb-a557-4777-95c2-f22aa7b6784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:22.632857 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1465/2913] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:22.653112 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774587ba-8cf4-4a46-9825-58921236a0f7 service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:22.665113 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774587ba-8cf4-4a46-9825-58921236a0f7 service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:22.671449 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c65a-eb9a-4c96-82ff-5c35bdd7fa0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:22.672048 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c65a-eb9a-4c96-82ff-5c35bdd7fa0b service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:22.672322 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c65a-eb9a-4c96-82ff-5c35bdd7fa0b service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:22.672618 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c65a-eb9a-4c96-82ff-5c35bdd7fa0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:22.681425 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c65a-eb9a-4c96-82ff-5c35bdd7fa0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:22.682989 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164c65a-eb9a-4c96-82ff-5c35bdd7fa0b service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:22.692450 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1449/2914] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:25.773920 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af0c66-68c6-41e7-aa07-b711b9d2595d None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:25.774485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af0c66-68c6-41e7-aa07-b711b9d2595d None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:25.774485 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af0c66-68c6-41e7-aa07-b711b9d2595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:25.803128 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-a1af0c66-68c6-41e7-aa07-b711b9d2595d None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:25.804757 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-a1af0c66-68c6-41e7-aa07-b711b9d2595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:25.814461 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1466/2915] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:25.842729 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c65a-eb9a-4c96-82ff-5c35bdd7fa0b service nova] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:25.858518 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164c65a-eb9a-4c96-82ff-5c35bdd7fa0b service nova] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:25.865759 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8d94a-3eb2-47cc-bf2f-15d8b89c3bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:25.866375 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d94a-3eb2-47cc-bf2f-15d8b89c3bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:25.866655 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d94a-3eb2-47cc-bf2f-15d8b89c3bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:25.866914 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d94a-3eb2-47cc-bf2f-15d8b89c3bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:25.877108 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d94a-3eb2-47cc-bf2f-15d8b89c3bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:25.878716 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d94a-3eb2-47cc-bf2f-15d8b89c3bb3 service nova] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:25.890630 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1450/2916] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:35.793964 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=18 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:35.885329 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=64 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:40.423342 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b343-ac3c-4175-8a43-b9ecf76d3393 None None] REQUEST_METHOD: `POST` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:40.424001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b343-ac3c-4175-8a43-b9ecf76d3393 None None] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:40.424001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b343-ac3c-4175-8a43-b9ecf76d3393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:40.445136 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.auth.core [None req-8b60b343-ac3c-4175-8a43-b9ecf76d3393 None None] MFA Rules not processed for user `31f4904c33ee407cb20f9aef3ab602e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81574) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:40.446380 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8b60b343-ac3c-4175-8a43-b9ecf76d3393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:40.455046 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1467/2917] 10.222.0.17 () {58 vars in 958 bytes} [Wed Aug 31 05:28:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:40.859579 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31228f1-93c1-4387-9830-2666f763ef24 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:40.860077 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31228f1-93c1-4387-9830-2666f763ef24 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:40.860213 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31228f1-93c1-4387-9830-2666f763ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:40.891678 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f31228f1-93c1-4387-9830-2666f763ef24 None None] MFA Rules not processed for user `ed29db7bc9ab441eb53fdbdcfd656c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:40.892875 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f31228f1-93c1-4387-9830-2666f763ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:40.951333 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1451/2918] 10.222.0.17 () {58 vars in 967 bytes} [Wed Aug 31 05:28:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:40.998394 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b343-ac3c-4175-8a43-b9ecf76d3393 None None] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:41.000502 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-8b60b343-ac3c-4175-8a43-b9ecf76d3393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:41.089969 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b343-ac3c-4175-8a43-b9ecf76d3393 None None] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:41.095533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a9e63804d3340b09aa7a3b0e7e8f2d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:41.096298 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:41.096636 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:41.096968 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:41.105569 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:41.107131 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:41.115315 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1468/2919] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Aug 31 05:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 05:28:47.205222 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31228f1-93c1-4387-9830-2666f763ef24 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:47.216861 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31228f1-93c1-4387-9830-2666f763ef24 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:47.221066 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45dadcdc0903427ca598dcd0bf06a6ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:47.221711 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:47.222018 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:47.222288 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:47.224225 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:47.242090 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:47.243560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:47.259457 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1452/2920] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:48.240488 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:48.242125 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:48.256042 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45b3f0-1d5b-416e-8156-2b4260a71ca6 service swift] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:48.260608 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:48.261282 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:48.261562 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:48.261831 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] PATH_INFO: `/v3/users/ef37778a847842d282fdf3c5ab030029` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:48.262950 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef37778a847842d282fdf3c5ab030029)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:48.264976 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:48.315268 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef37778a847842d282fdf3c5ab030029'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.315911 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef37778a847842d282fdf3c5ab030029'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.327843 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef37778a847842d282fdf3c5ab030029'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.335117 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef37778a847842d282fdf3c5ab030029'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.344726 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef37778a847842d282fdf3c5ab030029'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.351648 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1469/2921] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:28:48 2022] DELETE /identity/v3/users/ef37778a847842d282fdf3c5ab030029 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:28:48.521985 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:48.539779 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb117650-869b-4453-982b-bdffc4afba5a service neutron] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:48.604908 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:48.605625 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:48.605900 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:48.606166 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] PATH_INFO: `/v3/projects/6f638ebbcae444a7bfb899e9a332608b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:48.607922 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f638ebbcae444a7bfb899e9a332608b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:48.610010 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:48.669863 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f638ebbcae444a7bfb899e9a332608b', 'request_id': 'req-3739618e-f06e-494d-87a0-111d682e9b59'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.678560 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f638ebbcae444a7bfb899e9a332608b', 'request_id': 'req-3739618e-f06e-494d-87a0-111d682e9b59'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.684358 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f638ebbcae444a7bfb899e9a332608b', 'request_id': 'req-3739618e-f06e-494d-87a0-111d682e9b59'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.695698 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] The token cache is being invalidate because project 6f638ebbcae444a7bfb899e9a332608b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:28:48.695982 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.696676 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.698163 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1453/2922] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:28:48 2022] DELETE /identity/v3/projects/6f638ebbcae444a7bfb899e9a332608b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:28:48.702356 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:48.703952 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:48.717824 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09959218-df29-404c-b570-b7690f2c68a7 admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:48.773942 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:48.783385 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:48.784070 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:48.784371 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:48.785103 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] PATH_INFO: `/v3/users/451507b1078443da87e5097616338503` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:48.786582 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=451507b1078443da87e5097616338503)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:48.789134 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:48.846337 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451507b1078443da87e5097616338503'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.847096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451507b1078443da87e5097616338503'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.864915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451507b1078443da87e5097616338503'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.872501 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451507b1078443da87e5097616338503'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.885637 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451507b1078443da87e5097616338503'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:48.892776 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1470/2923] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:28:48 2022] DELETE /identity/v3/users/451507b1078443da87e5097616338503 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:28:49.081787 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:49.083400 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:49.102495 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739618e-f06e-494d-87a0-111d682e9b59 admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:49.112797 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:49.171243 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:49.171888 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:49.172170 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:49.172444 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] PATH_INFO: `/v3/projects/323020d2cc15498dba4da86937a023dd` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:49.173617 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=323020d2cc15498dba4da86937a023dd)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:49.175569 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:49.223481 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323020d2cc15498dba4da86937a023dd', 'request_id': 'req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:49.231715 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323020d2cc15498dba4da86937a023dd', 'request_id': 'req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:49.238236 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323020d2cc15498dba4da86937a023dd', 'request_id': 'req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:49.250798 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] The token cache is being invalidate because project 323020d2cc15498dba4da86937a023dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81573) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:28:49.251098 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:49.251769 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-3fe4aca8-a78b-4c3e-ac97-8a55c148e0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:28:49.265363 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1454/2924] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:28:49 2022] DELETE /identity/v3/projects/323020d2cc15498dba4da86937a023dd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:28:51.067478 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:51.068929 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:51.138540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e6bcd-9f53-4077-a591-173f00056a7e admin admin] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:51.191395 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e27abf26954289b3fcffa332e155a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:51.192001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:51.192278 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:51.192540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:51.194540 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:51.240145 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:28:51.268790 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:51.270328 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:51.281573 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1471/2925] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:52.894476 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a812-01b3-448e-a41c-ac9a1a3bc522 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:52.895065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a812-01b3-448e-a41c-ac9a1a3bc522 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:52.895065 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9a812-01b3-448e-a41c-ac9a1a3bc522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:52.916979 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-95b9a812-01b3-448e-a41c-ac9a1a3bc522 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:52.918216 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-95b9a812-01b3-448e-a41c-ac9a1a3bc522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:52.981590 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1455/2926] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:52.995312 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:52.997596 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:53.012178 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ff9b3-f18f-4d4b-afe0-89abdfc23885 service cinder] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:53.018291 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:53.018930 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:53.019233 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:53.019503 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:53.027939 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:53.029584 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:53.039556 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1472/2927] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:56.203395 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8817fe7-e85e-4651-8589-0b42730ca519 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:56.203950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8817fe7-e85e-4651-8589-0b42730ca519 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:56.203950 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8817fe7-e85e-4651-8589-0b42730ca519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:56.225206 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a8817fe7-e85e-4651-8589-0b42730ca519 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:56.226477 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a8817fe7-e85e-4651-8589-0b42730ca519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:56.235737 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1456/2928] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:56.250252 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:56.252034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.fernet_utils [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81574) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:56.270559 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2b10-ca89-461f-8c75-50c9cc105d75 service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:56.281511 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b3d41-ade6-4fdf-82cf-a45e108c5fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:56.282479 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b3d41-ade6-4fdf-82cf-a45e108c5fb5 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:56.283333 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b3d41-ade6-4fdf-82cf-a45e108c5fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:56.283796 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b3d41-ade6-4fdf-82cf-a45e108c5fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:56.293609 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b3d41-ade6-4fdf-82cf-a45e108c5fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:56.295714 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b3d41-ade6-4fdf-82cf-a45e108c5fb5 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:56.313115 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1473/2929] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:28:59.321299 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfb79d-21ce-4e2c-9997-243a14f7a22a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:59.321839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfb79d-21ce-4e2c-9997-243a14f7a22a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:59.321839 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfb79d-21ce-4e2c-9997-243a14f7a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:59.346053 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a4cfb79d-21ce-4e2c-9997-243a14f7a22a None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:28:59.347494 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a4cfb79d-21ce-4e2c-9997-243a14f7a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:28:59.360886 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1457/2930] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:28:59.375533 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b3d41-ade6-4fdf-82cf-a45e108c5fb5 service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:28:59.387321 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b3d41-ade6-4fdf-82cf-a45e108c5fb5 service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:28:59.395002 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b438c62-8590-4199-a18d-a5fd537929db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:28:59.395593 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438c62-8590-4199-a18d-a5fd537929db service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:28:59.395860 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438c62-8590-4199-a18d-a5fd537929db service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:28:59.396124 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b438c62-8590-4199-a18d-a5fd537929db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:28:59.405465 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b438c62-8590-4199-a18d-a5fd537929db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:28:59.407019 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b438c62-8590-4199-a18d-a5fd537929db service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:28:59.418138 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1474/2931] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:29:02.491992 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa681-c4b7-465c-bdea-c2e3f4c4c953 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:29:02.492486 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa681-c4b7-465c-bdea-c2e3f4c4c953 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:29:02.492596 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa681-c4b7-465c-bdea-c2e3f4c4c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:29:02.513896 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f46fa681-c4b7-465c-bdea-c2e3f4c4c953 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:29:02.515094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f46fa681-c4b7-465c-bdea-c2e3f4c4c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:29:02.523342 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1458/2932] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:29:02.541355 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b438c62-8590-4199-a18d-a5fd537929db service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:29:02.553209 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b438c62-8590-4199-a18d-a5fd537929db service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:29:02.559226 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c8069-928c-4dac-819b-449c27697534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:29:02.559814 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8069-928c-4dac-819b-449c27697534 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:29:02.560089 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8069-928c-4dac-819b-449c27697534 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:29:02.560362 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c8069-928c-4dac-819b-449c27697534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:29:02.569874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c8069-928c-4dac-819b-449c27697534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:29:02.571473 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c8069-928c-4dac-819b-449c27697534 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:29:02.581397 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1475/2933] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:29:05.717939 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa320c0-77ef-4953-b138-3fa0b21a4ef3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:29:05.718506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa320c0-77ef-4953-b138-3fa0b21a4ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:29:05.718506 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa320c0-77ef-4953-b138-3fa0b21a4ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:29:05.739414 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6fa320c0-77ef-4953-b138-3fa0b21a4ef3 None None] MFA Rules not processed for user `08b48eac02ed4bf2b170e97ff2aa351b`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 05:29:05.741219 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6fa320c0-77ef-4953-b138-3fa0b21a4ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:29:05.755439 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1459/2934] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 31 05:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 05:29:05.787058 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c8069-928c-4dac-819b-449c27697534 service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:29:05.798915 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c8069-928c-4dac-819b-449c27697534 service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:29:05.806122 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e0ab6-e390-4ca8-8d8c-6a749a8bdf25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f5576a90945429a9127a2d4c53a729c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:29:05.806763 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e0ab6-e390-4ca8-8d8c-6a749a8bdf25 service nova] REQUEST_METHOD: `GET` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:29:05.807025 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e0ab6-e390-4ca8-8d8c-6a749a8bdf25 service nova] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:29:05.807300 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e0ab6-e390-4ca8-8d8c-6a749a8bdf25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:29:05.815820 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e0ab6-e390-4ca8-8d8c-6a749a8bdf25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:29:05.817407 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e0ab6-e390-4ca8-8d8c-6a749a8bdf25 service nova] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:29:05.827034 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1476/2935] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:29:15.733431 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:15.823001 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=43 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:34.108529 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa320c0-77ef-4953-b138-3fa0b21a4ef3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:29:34.110094 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6fa320c0-77ef-4953-b138-3fa0b21a4ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:29:34.123541 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa320c0-77ef-4953-b138-3fa0b21a4ef3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:29:34.128732 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:29:34.129410 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:29:34.129688 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:29:34.129955 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] PATH_INFO: `/v3/users/31f4904c33ee407cb20f9aef3ab602e9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:29:34.131193 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f4904c33ee407cb20f9aef3ab602e9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:29:34.133172 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:29:34.184941 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f4904c33ee407cb20f9aef3ab602e9'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.196520 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f4904c33ee407cb20f9aef3ab602e9'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.203249 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f4904c33ee407cb20f9aef3ab602e9'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.212227 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f4904c33ee407cb20f9aef3ab602e9'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.212948 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f4904c33ee407cb20f9aef3ab602e9'} {{(pid=81573) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.219308 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1460/2936] 10.222.0.17 () {58 vars in 1224 bytes} [Wed Aug 31 05:29:34 2022] DELETE /identity/v3/users/31f4904c33ee407cb20f9aef3ab602e9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:29:34.400050 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e0ab6-e390-4ca8-8d8c-6a749a8bdf25 service nova] Authenticating user token {{(pid=81574) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:29:34.410716 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e0ab6-e390-4ca8-8d8c-6a749a8bdf25 service nova] Validating token access rules against request {{(pid=81574) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:29:34.468874 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08b48eac02ed4bf2b170e97ff2aa351b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e8c567a5ea14fdea15f5fb60bb768ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81574) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:29:34.469544 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:29:34.469825 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:29:34.470096 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] PATH_INFO: `/v3/projects/3458b362dab6403bb0edb23cbbfdb53e` {{(pid=81574) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:29:34.471214 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3458b362dab6403bb0edb23cbbfdb53e)` {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:29:34.473181 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] RBAC: Authorization granted {{(pid=81574) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:29:34.521341 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3458b362dab6403bb0edb23cbbfdb53e', 'request_id': 'req-142ab56e-f88c-484c-8328-a456af0f5356'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.526847 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3458b362dab6403bb0edb23cbbfdb53e', 'request_id': 'req-142ab56e-f88c-484c-8328-a456af0f5356'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.533535 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3458b362dab6403bb0edb23cbbfdb53e', 'request_id': 'req-142ab56e-f88c-484c-8328-a456af0f5356'} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.548448 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] The token cache is being invalidate because project 3458b362dab6403bb0edb23cbbfdb53e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81574) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 05:29:34.548735 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.549391 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG keystone.notifications [None req-142ab56e-f88c-484c-8328-a456af0f5356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81574) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 05:29:34.550922 dv-cinder-852208-14-smb devstack@keystone.service[81574]: [pid: 81574|app: 0|req: 1477/2937] 10.222.0.17 () {58 vars in 1233 bytes} [Wed Aug 31 05:29:34 2022] DELETE /identity/v3/projects/3458b362dab6403bb0edb23cbbfdb53e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 05:29:44.215740 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:29:44.544061 dv-cinder-852208-14-smb devstack@keystone.service[81574]: DEBUG dbcounter [-] [81574] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 05:32:08.091548 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 05:32:08.093307 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:32:08.177433 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26218bbc-0a17-41de-8027-2b4c791dd1ae admin admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 05:32:08.240641 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770d260-4655-4228-ae52-c35415025ab8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72030c047a444f81ba3c482f99f78486', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '155ef0966d5d4b3e80dd5bec11edd729', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 05:32:08.241359 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d260-4655-4228-ae52-c35415025ab8 service placement] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 05:32:08.241636 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d260-4655-4228-ae52-c35415025ab8 service placement] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 05:32:08.241919 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770d260-4655-4228-ae52-c35415025ab8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 05:32:08.243722 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-7770d260-4655-4228-ae52-c35415025ab8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 05:32:08.254998 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770d260-4655-4228-ae52-c35415025ab8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 05:32:08.256593 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770d260-4655-4228-ae52-c35415025ab8 service placement] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 05:32:08.272351 dv-cinder-852208-14-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1461/2938] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Aug 31 05:32:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 05:32:18.264811 dv-cinder-852208-14-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=58 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}